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If an original transcript was made of the event, the video 
product allows the user to play back the video while also 
viewing the page and line numbers of the original transcript. 
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SYSTEM FOR CREATING VIDEO OF AN been videotaped, it is desirable to have the ability to use the 

EVENT WITH A SYNCHRONIZED video associated with key statements to impeach, or to 

TRANSCRIPT expose an inconsistency between a witness' and earlier 

testimony or to show witness demeanor. Prior to the present 

FIELD OF THE INVENTION s invention, it has been difficult for attorneys to randomly 

The present invention relates to a process and apparatus scarch throu ^ f nd lhei J ™ w the v j dc0 jf*™- 

for creating a randomly accessible video product which Uon ™ th key ^ ™ & * ^° VlC ? ^ "T'tu* 

includes video of an event and the associated transcript, the *|°™y had t0 havc «*« * a vldcota P e ^ c ^ r 

.... v , , . , _ , B . j „ * (K ,,, 01 .j on a TV screen or monitor. At the same time, it is difficult to 

transcript being linked to and synchronized with the video , . / j • l 

for simultaneous vie win 10 s or rcview sp eci fi c videotape segments during research 

or simu aneous l i g. ^ ^ because 0 j me t ^ consumm g an d inexact process 

BACKGROUND OF THE INVENTION of positioning the videotape to the correct location. In 

addition, some current systems require the attorney to select 

Testimony is a proceeding in which an attorney asks oral important video segments ahead of time so that a video 

questions of a witness. A word-for-word record of the ^ cm make a short videotape containing the segments 

questions asked and the answers given is called the testi- of interest It is difficult, if not impossible, to select new 

mony transcript. Testimony is normally taken dunng a segments during trial if there is a change in testimony or 

deposition or a trial. Testimony is recorded by a court theory 

reporter using a special typewriter-like device normally ^ g ^ available ^ while 

referred to as a stenograph machine. The ou put of the M P ^ d ificall for 

stenograph machine is a long VWj£Zfj^to£X Utig.tion. video depositions and court room presentations, 

characters capturing ,n _» form of short hand, the word-for- B > syst6 ms rely on videotape technology which is 

word record of the testimony. The court reporter uses the ' J r u ,»^« 

t / . . - \. a linear video access technology. No matter how the video - 

paper tape to create a text translaUon of the tape. This . ~ m „**. r 

Fy 1 . h . , , t j «, , tape is indexed or linked with the text and no matter what 

translation is created using a typewriter or a word processor. ? . . . Af( , 

It r , <• • r j « ♦ ■ ♦ nuLt; mnn „ 25 type of system is used to control the location of the video- 

The translates referred to as a transenpt of the testimony ^ * inforrnation , acc6SS t0 lhe tape is 

and is created "off-line from the actual testimony. accomplished only by the time-consuming process of mov- 

More recently, stenograph machines and computer soft- . (he lin . forward of backward 

ware programs have been developed which translate the * 

phonetic characters while the stenograph operator is typing. 30 J^*^ The tem m ^ patent ^ 

Theou putof hisautomated translation, a tr amof^a • ■ I > * ^ ^ ^ 

characters which are stored on a cassette or in a personal & *i e « ^.i p<- „ QTr i f rtrv ;™„o p VPn 

computer attached directly to the stenograph machine by a rc ^ ir f a ta Pf deck and ^ ccial for viewing. Even 

V j b r ^ though the videotape is indexed with information linking the 

serial communications link. These types of stenograph u " & f ™«„„ l^f^u, 

machines and the associated computer and software are 35 video to the testimony it is still necess y to h«arly 

referred to as Computer-Aided Transcription or CAT sys- P«tion the videotape. In addition an end user must pur- 

terns. The output of the CAT system is an ASCII text <*ase both a PC and appropriate audio/video equipment, 

computer file of the testimony. The court reporter edits the Despite the numerous systems known for linking video to 

ASCII file to create a final version of the transcript which testimony, there is still a need for a system that stores video 

can be viewed on a computer or can be printed. The Lawyer 40 and written information on random access media (e.g., 

uses the ASCII file for many purposes including research of CD-ROM and diskette) to allow instantaneous access to any 

the deposition, preparation for trial and research prior to location in the video and that eliminates the need for a 

cross examination during trial. A variety of software tools videotape deck and TV screen to view video. In addition, 

have been developed which, among other things, allow a there is a need for a system which creates a product on 

lawyer to electronically search testimony text for key words, 45 random access media, and once created, can use existing 

to annotate, to insert page marks, to associate certain por- software tools for researching and analyzing text and for 

tions of testimony with issues and to create printouts of instantaneously accessing the corresponding video informa- 

testimony for insertion in pleadings and trial presentations. Uon using only a single personal computer. There is also a 

Along with the development of CAT systems, another need for a system which can create such a product from any 
parallel development has taken place. In major and/or com- 50 tv ? e of eveDt > le & al or otherwise - ™ e P resent mVentl ° n miS 

plex litigation cases, testimony from depositions and/or a mis need - 

trial have been videotaped in addition to having a transcript SUMMARY OF THE INVENTION 
created. The person performing the videotaping is called a 

videographer. The videographer uses a standard, commer- The present invention is a method of creating a video 
cially available videotape recording system. Videotaping 55 product with synchronized video and text of an event, 

proceeds simultaneously with the creation of the written Before the method is performed, a first video record is made 

record of the testimony by the court reporter. After the of the event and stored on a first storage medium, and an 

testimony is complete, the lawyer will normally ask the original transcript of the event is made and stored on a 

court reporter for a copy of the ASCII text file of the second storage medium, the second storage medium being a 
testimony and will ask the videographer for a copy of the 6 o random access medium. The original transcript contains 

videotapes of the testimony. spoken word information and format information. The for- 

During the discovery and research phase of a litigation, mat information includes page and line numbers. The first 

the attorney will search through testimony for key state- step of the method is to generate a converted transcript 

ments made by a witness. The attorney uses software tools which includes only the spoken word information, but which 
for searching and annotating the ASCII testimony. In 65 maintains the same lines of spoken word information as in 

addition, during a trial the attorney will present to the court the original transcript. The lines of the converted transcript 

and jury a specific part of the testimony. When testimony has are sequentially numbered and have a predetermined rela- 
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tionship to the page and line numbers of the original chronization Program (LIPSYNC). FIG. 7 also shows the 

transcript. Next, a second video record is made on a third operational steps used when there is no time or SMPTE code 

storage medium from the first video record. The second information on the ASCII disks or VHS tapes created in the 

video record has sequentially numbered video frames. The process of FIG. 1; 

third storage medium is a random access storage medium. 5 fjg. 8 is an operational flow diagram of the special 

Next, the converted transcript is displayed on a computer operational steps used when there is time or SMPTE code 

while the second video record is played on the same com- information on the ASCII disks or VHS tapes created in FIG. 

puter. A signal is sent to the computer at each line of the i; 

converted transcript when the second video record matches FIGS 9 _ 14 are project log and processing sneets ^ 6 t0 

the current line of text of the converted transcript. The 10 tfack projectS( tapes> video files and ASCII files when 

signals and the video frame information are used to create an per f 0 rming the processes in FIG. 1; and 

index of the page and line numbers of the original transcript ni _ ... . , , . ,. 

i .j £ Ci . i ■ i jr™ j FIG. 15 is a system level diagram showing an alternative 

to the video frames of the second video record. The page and ... . * • u**u u 

v u * a f _ TQT .,^ t _r" • t embodiment of the present invention wherein the synchro - 

line numbers are recreated from the converted transcript , . . . x K A , - A . 

, 4 , « , j , , . mzed video product is created from an event in real-time or 

lines and the predetermined relationship therebetween. 15 „ •, . c 

XT ^ , . , j.u ■ * ♦ a from a prerecorded version of the event. 

Next, the index and the converted transcript are stored on a v 

fourth storage medium. The fourth storage medium is a DETAILED DESCRIPTION OF PREFERRED 

random access medium. Together, the third and fourth EMBODIMENT 

storage media are the video product. The video product is . . ■, . • r 

usable to simultaneously play back the second video record, 20 Certain terminology is used herein for convenience only 

the corresponding transcript, and the original page and line and * ** be ] ak f n a limitation on the present invention, 

numbers by using the index on the fourth storage medium. ™ e word " Vlde0 ' mcaQS eithcr visual and audl ° data or just 

, , , 4l _ . , u „. audio data. Viewing a "video" implies that the user is both 

In one embodiment of the invention the signalling is ^ hcari * me video Howevcr> certain disclosed 

performed by an operator. In other embodiments of the ^ ^ of te p ^ t iwention requ ^ only ^ 

invention, SMPTE or time information stored on one or both 25 "hear" the video In the drawings, the same refer- 

of the original transcript and first storage medium are used ^ afe for ^ ^ ^ 

to automatically create the video product. ^ throughout the figurcs 

In another embodiment of the invention, a method is Th e present invention is explained in six sections. Section 

provided to automatically create the video product in a ! ^ an overview of the present invention. Section II is a brief 

real-time manner at a live event, or while playing back a description of the programs which were specifi- 

recording of a live event. cally deve]oped t0 create and ^ a preferred inventive 

Additional embodiments of the invention provide appa- product. The software programs interface with existing 

ratus for performing the methods above. software programs, identified below. Section III is a brief 

RRTFF DFSPRIPTION OF THE DRAWINGS 35 descri P tion of three overa11 Presses which are required to 

BRIEF DESCRIPTION OF THE DRAWINGS create ^ preferred inventive product< Section IV is a 

The foregoing summary, as well as the following detailed detailed description of preferred embodiments for creating 
description of preferred embodiments of the invention, will the inventive product, and are described in conjunction with 
be better understood when read in conjunction with the FIGS. 1-8. Section V is an operations manual which pro- 
appended drawings. For the purpose of illustrating the 40 vides a detailed description of the step-by-step tasks and 
invention, there are shown in the drawings embodiments related file structures for carrying out some of the preferred 
which are presently preferred. It should be understood, embodiments. Section V is described in conjunction with 
however, that the invention is not limited to the precise FIGS. 9-14. Section VI is a printout of the Form Text and 
arrangements and instrumentalities shown. In the drawings: graphical representation files for XCON (referred to as 

FIG. 1 is a system level schematic diagram showing the 45 CONVERT below), LIPSYNC and VIDLINK for the pre- 
processes of a preferred embodiment of the present inven- ferred embodiments of the invention as described in Sec- 
tion for creating a synchronized video product, the related tions II-V. XCON is Part 1 of the printout, LIPSYNC is Part 
video and text viewing software, and the manner in which 2 of the printout, and VIDLINK is Part 3 of the printout, 
these components interface with computer, videographic, The present invention is described in the context of 
stenographic and courtroom technologies; 50 capturing and synchronizing video and transcripts from a 

FIG. 2 is a system level schematic diagram showing the legal proceeding. However, the scope of the invention is 

physical configuration of equipment used for a VHS Tape much broader - ™* P resent invention may be used to capture 

Conversion Process in FIG. 1; and synchronize a recording of any event to a separately 

, . , 1 1 j- u • u - 1 created transcript of the event. No video component may 

FIG. 3 is a system level diagram showing the physical • r A. , i_ ■ *u e • « 

- I t • . * r „ £/tw 55 even exist for the event, such as in the case of a wiretap 

configuration of computer equipment used tor the lext 5 r 

re c orcl in f? 

Conversion Process and the Voice Synchronization Process _ . f ' . . 

. ^ 3 Section I-Overview of present invention 

m m ' \ . r . ,„ IC , _ The present invention incorporates an integrated set of 

FIG. 4 is an operational flow diagram of the VHS Tape processes and a scl 0 f software programs for the transfer of 

Conversion Process in FIG. 1; 6Q v j dcotapcd testimony to a random access storage medium 

FIG. 5 is an operational flow diagram of the ASCII Text ( e g ^ CD-ROM), the synchronization of the video testimony 

Conversion Process in FIG. 1 which uses a Transcript with the text of the testimony, and the display of both video 

Conversion Program (CONVERT); and synchronized text on a personal computer screen for the 

FIG. 6 is a flow diagram of the Transcript Conversion purposes of litigation research and video presentation during 

Program; 65 trial. 

FIG. 7 is an operational flow diagram of the Voice To take advantage of advances in digital video compres- 

Synchronization Process in FIG, 1 which uses a Lip Syn- sion and recording technologies, all software programs were 
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developed using Microsoft's standard Windows and associ- 
ated video interfaces. The present invention also makes use 
of existing software and hardware developed for Microsoft's 
Windows platform. This includes software and hardware for 
the capture, digitization, compression, editing and playback 
of digital video information. 

The disclosed embodiment of the present invention works 
with current VHS tape systems for recording video deposi- 
tions and provides a VHS Tape Conversion Process which 
can convert existing VHS tapes to compressed digital format 
and then transfer the digital video information to CD-ROM. 

The indexing scheme used by attorneys to reference 
testimony is page and line number of a transcript (e.g., page 
45, line 12). ASCII files created by different CAT systems 
have page and line numbers in different places and insert a 
variety of extraneous text lines in the footers and headers of 
the transcript. To have general applicability to current CAT 
systems and for the synchronization and text viewing soft- 
ware to be able to determine the testimony page and line 
number of the ASCII text, the present invention provides a 
process and software program for converting any ASCII file 
into a Common ASCII File Format. During the conversion, 
all extraneous text is removed from the ASCII File. A 
computer program allows for recreation of the correct page 
and line numbers from the Common ASCII File. 

The compressed digital video information on CD-ROM 
must ultimately be synchronized with the text of testimony. 
Accordingly, the present invention provides a process and 
supporting software program for synchronizing testimony 
text in Common ASCII File Format with digital video files 
on CD-ROM. 

Some currently marketed CAT systems can link to a video 
camera and stamp time or SMPTE code information on the 
ASCII data as it is generated. The present invention accom- 
modates this additional time or SMPTE code information in 
the synchronization process. (A SMPTE code includes time, 
date and frame information.) 

To view both text and synchronized video, the present 
invention provides a video and text viewing program for 
displaying on a computer screen the video that is stored on 
CD-ROM along with the synchronized text. In addition, to 
have applicability to existing text viewing software, the 
present invention has an Application Programming Interface 
(API) for the video viewing portion of the program that 
allows existing text viewing software to add the video 
capability. The video viewing API can interface with the 
most commonly used programs for viewing and researching 
testimony. For courtroom display of video, the video view- 
ing portion of the program can enlarge the video display on 
the computer screen or a court room projection system, and 
uses standard CD-ROM changers and jukeboxes which hold 
several CD-ROMs at one time. This allows the attorney or 
program operator to have on-line access to several hours of 
video. 

Section II -Brief description of the software programs 

The following three software programs were developed as 
part of this invention. These programs are used in the 
processing steps for converting and synchronizing video and 
are used to display synchronized text and video on a 
computer screen. The programs were all developed 
Microsoft's Windows using Microsoft's Visual Basic for 
Windows and associated Visual Basic controls (VBXs) for 
audio and video. These controls provide a standard set of 
video functions such as open video file, play the file, 
advance to a specific frame, etc. By developing the programs 
for this invention using standard Microsoft Windows 
interfaces, the present invention can take advantage of future 
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advances in video compression and display technology, 
since such new technologies will adhere to the Microsoft 
Windows standard. The present invention can make use of 
any compression technology currently available that is com - 
5 patible with Windows. 

1. Transcript Conversion Program (CONVERT) 

The CONVERT program converts ASCII files received 
from a court reporter into a common format that allows a 
computer program to determine the page and line number of 

10 each line of testimony text. The program discards all extra- 
neous text, such as headers and footers inserted by the court 
reporter. If time or SMPTE code information is available 
with the text, the program saves such information in a 
PRESYNC file. The program requires the operator to visu- 

15 ally review an ASCII file prior to conversion in order to 
determine the starting column numbers of transcript text and 
any time or SMPTE code information. 

2. Lip Synchronization Program (LIPSYNC) 

The LIPSYNC program is used to synchronize the text 

20 and video. The program allows the operator to load a text file 
and associated video files. Once loaded, the text and video 
is viewed in two windows on the computer screen. The 
operator plays the video and listens to the associated audio 
and, at the same time, reads the testimony text. While 

25 listening to the audio and reading the text, the operator 
presses special keyboard keys to synchronize the video and 
text. The output of the LIPSYNC program is a SYNC file 
that links every page and line of the testimony to a frame 
number in the video. 

30 3. Video and Text Viewer Program (VIDLINK) 

The VIDLINK program is used by an operator to view 
synchronized video and text. The program creates two 
windows on a computer monitor. One window contains the 
text and the other window contains the associated video. The 

35 operator is given tools to search and scroll through the text 
and video. Whenever the operator moves to a new location 
in the text, the video jumps to the same point, likewise, 
moving around in the video or playing the video in real time 
cause the text to move to the same point or to scroll along 

40 with the video. The VIDLINK program contains tools for 
importing a transcript and associated SYNC files and video. 
It also contains an application programming interface (API) 
for accessing the video viewer portion of the program. This 
API provides a standard interface to other transcript viewing 

45 programs that run on Windows. It allows such programs to 
add synchronized video to the respective text viewing func- 
tions of the program. 
Section Ill-Brief description of processes 

The following three processes are used to create an 

so inventive product. 

1. VHS Tape Conversion Process 

The Tape Conversion Process uses commercially avail- 
able hardware and software products for capturing, digitiz- 
ing and compressing digital video files in a specific format 
55 used by the Voice Synchronization Process and text and 
video display software (VIDLINK) of the invention. The 
process also uses existing hardware and software for writing 
digital video files to CD-ROM. 

2. ASCII Text Conversion Process 

60 The Text Conversion Process uses the CONVERT pro- 
gram to convert an ASCII disk received from a court reporter 
into the Common ASCII File Format (CAFF) used by the 
Voice Synchronization Process and VIDLINK. 

3. Voice Synchronization Process 

65 The Voice Synchronization Process uses the LIPSYNC 
program to link together digital video testimony on 
CD-ROM and ASCII text in Common ASCII File Format. 
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Section IV-Detailed description 

Referring to FIG. 1, a videographer makes a video record- 
ing (first video record) of testimony in a legal proceeding 
using a video camera 1 and videotape recorder 2. The 
process generates one or more VHS tapes 3 (first storage 
medium). Normally, one VHS tape holds up to two hours of 
video when recorded on its fastest speed, the speed that 
provides the best resolution. One day of testimony typically 
generates three or four tapes at the fastest speed. A court 
reporter (not shown) simultaneously records testimony 
using a transcription device or stenograph machine 4. The 
machine 4 normally records the testimony on a paper tape in 
the form of phonetic characters which are a shorthand, 
word-for-word record of the testimony. Alternatively, the 
machine 4 is equipped for Computer- Aided Transcription 
(CAT). The output of the machine 4 is recorded onto a 
cassette 4A, diskette 4B or onto a personal computer S 
connected by a serial communications cable 4C to the 
stenograph machine 4. Regardless of the method of 
recording, the software in a personal computer 5 creates the 
ASCII text of the testimony and copies the text onto a 
diskette 6 (second storage medium). The contents of the 
diskette 6 is thus an original transcript of the legal proceed- 
ing and includes spoken word information and format infor- 
mation. Format information includes page and line numbers, 
headers and footers. The header typically identifies the party 
being deposed or testifying and the footer typically identifies 
the transcript service provider. Some CAT systems may also 
be connected via a cable 2A to the videotape recorder 2 
which generates a continuous time stamp or SMPTE code 
for insertion into the ASCII text, effectively time stamping 
each line of text. The same time or SMPTE code is also 
written to audio channel B of the VHS tape 3. 

The VHS tape 3 goes through a Tape Conversion Process 
7. The output of the Process 7 is a second video record on 
one or more CD-ROMs 10 (third storage medium). Each 
CD-ROM 10 includes sequentially numbered video frames 
(e.g., 1 to n). The diskette 6 goes through a Text Conversion 
Process 8 described below. The CD-ROM(s) 10 and diskette 
6 are then used together in a Voice Synchronization Process 
9, the output of which is a diskette 24 (fourth storage 
medium) containing synchronization files and converted 
text. Together, the CD-ROM(s) 10 and diskette 24 constitute 
the video product 26 created by the system. Video and Text 
Viewing Software 15 is used to check that the video product 
26 was properly made. When it is desired to use the video 
product 26, the CD-ROM(s) 10 are loaded into a CD-ROM 
drive or multiple CD-ROM device such as a jukebox or 
CD-ROM changer 28 which is connected to a multimedia 
computer 30. The diskette 24 and Video and Text Viewing 
Software 15 are loaded into the multimedia computer 30, 
and the software 15 is started. The output of the multimedia 
computer 30 is displayed on the computer monitor. 
Alternatively, the output may be displayed on a projection 
system 32. 

FIG. 2 shows the processing system used to transfer video 
on a VHS tape 3 to a random access storage medium, 
CD-ROM 10 (VHS Tape Conversion Process 7 shown in 
FIG. 1). The Processing 7 system includes one or more 
videotape playback decks 11 and an audio/video switch 12 
for switching the deck output (audio, video and time code 
information) to one or more capture systems 13. Each 
capture system 13 includes a PC 14 configured with a large 
mass storage system 18 and a CD-ROM writer 19. The mass 
storage system 18 can be any high capacity, high volume, 
magnetic disk storage system. The requirements for the mass 
storage system 18 are a data transfer speed capable of 
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supporting real-time video capture (this currently requires 
magnetic disk technology) and a data storage size capable of 
holding several hours of digital compressed and 
un-compressed video information. The capture system PC 

S 14 is also configured with a video capture hardware card 
compatible with Microsoft's Windows, such as an Intel 
Smart Video Recorder Pro card or an Opti Vision MPEG 
capture card. The CD-ROM writers 19 are any commercially 
available CD-ROM writer and associated software capable 
of writing data files to CD recordable (CDR) media. 

The capture system PCs 14 are connected via a Local Area 
Network (LAN) 20. Also attached to the LAN 20 are one or 
more compression computers 21. The compression comput- 
ers 21 are high speed Intel Pentium or equivalent processors 
configured with Windows and digital video editing software 

15 compatible with Windows, such as Asymmetric' s Digital 
Video Producer. The compression computers 21 perform 
digital video processing on video files that have been 
captured by the capture systems 13 and stored on a respec- 
tive mass storage system 18. Since digital processing such as 

20 compression is very high in CPU utilization but very low in 
disk utilization, the video files are accessed via the LAN and 
don't have to be moved to a local drive of a compression 
computer 21. By keeping all digital video files in one 
location, it is not necessary to move around such very large 

25 files, an extremely time consuming process. Also, there is no 
capture software currently available that can run on the 
server of a client/server LAN. For these reasons, the LAN 20 
is preferably a peer to peer LAN such as Microsoft's 
Windows for Workgroups. 

30 Once the digital video files are created by the capture 
systems 13 and processed by the compression computers 21, 
they are written directly to CD-ROMs 10 by the CD-ROM 
writers 19. Again, since a peer to peer LAN is used, it is not 
necessary to move around such very large files. The files can 

35 be written directly to the CD-ROMs 10 from the mass 
storage systems 18. CD-ROM writers 19 require a very high 
data transfer rate during the write process. If the digital files 
were stored on a server in a client/server LAN, the LAN 
might not be able to maintain the required data transfer rate. 

^o FIG. 4 shows an operational overview of the steps for 
transferring video from a single deposition having been 
previously recorded on one or more VHS tapes 3 to a 
CD-ROM. Video on the tapes 3 is captured, digitized and 
stored in files on the mass storage system 18. Depending on 

45 the type of video capture and digitization hardware used, the 
files may have to be compressed by the compression com- 
puters 21. Compression requires a significant amount of 
processing time. For example, it can take several seconds to 
compress one frame of digitized video. Since video frame 

50 rates range from 15 to 30 frames per second, compressing 
one hour of video can take several hours. To reduce the 
elapsed time needed for compression, the video on each 
VHS tape is separated into small files, called segments, 
during the capture process. The segments are then com- 

55 pressed by the compression computers 21 in parallel. Once 
compressed, the video segments are written to a CD-ROM 
10. 

One type of CD-ROM commonly used today holds about 
640 MBytes. The optimal size of the video file segments 

60 needed to fill up each CD-ROM must be determined prior to 
capture. The size of the segments is also a function of the 
number of compression computers 21 and the length of 
video on each tape. For convenience during capture, video 
segments do not span from one tape to another. To calculate 

65 the optimal length of the segments to minimize elapsed 
processing time, the length of video on each tape must first 
be determined. 
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Referring to FIG. 4 (steps 100-104), each VHS tape 3 is 
loaded into a tape deck and fast forwarded to find the end of 
the video (step 102). The total time is recorded for each tape. 
Once the length of the video on each tape is known, the size 
of each video segment is determined (step 106). For 5 
example, one CD-ROM holds about 80 minutes of video 
when made as follows: 



capture and compression hardware Intel's Smart Video Recorder 
capture and compression software Inters Indeo 3.2 compression 
algorithm 

frame rate 15 frames per second 

frame size 240 x 180 

data rate 130 KBytes per second 



If four compression computers 21 are available, each 
compression computer 21 compresses a 20 minute segment. 
If the VHS tape holds two hours (120 minutes) of video, then 
the capture process should separate the video into six, 20 
minute segments. The first four 20 minute segments of tape 20 
1 go onto a first CD-ROM. The next two 20 minute segments 
of tape 1 are combined with two 20 minute segments from 
tape 2 to fill out a second CD-ROM. Normally it is not 
possible to fill out the last CD-ROM since the total minutes 
of video on all VHS tapes will not be divisible by 80 25 
minutes. Also, the number of minutes on each VHS tape 
varies, causing some segments to be less than 20 minutes. 

Note that during the actual capture process, described 
below, the size of the segments change slightly to make 
clean cut points between each segment. During video 30 
testimony, there are many pauses in the audio. It is desirable 
to have a cut point (end of a segment) at one of the pauses 
so that the ending frame of one segment does not have to 
precisely match the beginning frame of the next segment. 
For example, segment one could end on frame 2300 and 35 
segment two could begin on frame 2302. There is no 
substantive loss of video information. In this manner, the 
need to have precise, frame level control over the tape deck 
is eliminated, which reduces the cost and complexity of the 
tape deck and operating costs. 40 

Once the size of the segments for each VHS tape is 
determined, the actual capture and compression process 
begins. Referring again to FIGS. 2 and 4, the first step is to 
load a VHS tape 3 into the tape deck 11 (step 108). Next, the 
A/V switch 12 is switched to the appropriate capture system 45 
13, Commercially available capture software compatible 
with Windows can be used, such as Asymmetric's Digital 
Video Producer video capture software. Such software is 
initialized to capture the next video segment (step 110). To 
perform step 110, a video segment file is established to 50 
receive the video as it is digitized and copied into the 
computer 14 by a video capture card. One suitable video 
capture card is an Intel Smart Video Recorder card. In 
addition to the video information, a small time code file is 
also established if the VHS tape has time code or SMPTE 55 
code information on it. The time code file holds the time 
code or SMPTE code information associated with the cor- 
responding segment. Time code or SMPTE information is 
usually stored in audio channel B of the VHS tape 3. The 
tape deck 11 reads the time information and outputs the time 60 
information to the capture PC 14 for storage in the 
PRESYNC file. 

When the capture software is ready, the tape deck 11 
"play" button is pushed and the start capture command is 
entered into the capture PC software. Videographers nor- 65 
mally have a small amount of blank video at the beginning 
of a VHS tape. Since there is no audio in the blank area, it 
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doesn't need to be captured. The tape deck thus starts prior 
to the capture software. Likewise, cut points between seg- 
ments are done at pauses in the audio, allowing the capture 
software to be stopped prior to stopping the tape and 
allowing the tape to be started prior to restarting the capture 
software. A video processing sheet is used to manually 
record the start and stop locations for each segment. FIG. 12 
(described further below) shows an example of such a sheet. 

Referring again to FIGS. 2 and 4, a single mass storage 
system 18 may not be able to hold all the captured segments 
for all the VHS tapes 3. When capturing video segments 
(step 110), the amount of space left on the currently used 
mass storage system 18 must be monitored. When the mass 
storage system 18 is full (step 112), the captured segments 
must be compressed (step 114) and written to CD-ROM 10 
(step 116) using the CD-ROM writer 19 and CD-ROM 
writer software. One suitable CD-ROM writer software is 
Corel's CD Creator. In step 114, video segments are com- 
pressed in parallel by the compression computers 21. The 
compression computers 21 access the video segments on the 
mass storage system 18 via the peer to peer LAN 20. Once 
all of the segments have been compressed using compres- 
sion software such as Digital Video Producer, the segments 
are written to CD-ROM 10 and checked for good audio and 
video playback (step 116) using standard playback software, 
such as Microsoft's Media Player. If errors are present, the 
problem segment is either recompressed or possibly recap- 
tured and recompressed depending on the type of error. Once 
the compressed segments have been moved to CD-ROM 10, 
the capture files are deleted from the mass storage system 
18. Any more segments on the current VHS tape can then be 
captured (step 118). As the segments on each VHS tape are 
completed, new VHS tapes are loaded (step 108). The 
process continues until all tapes have been processed (step 
120). 

Some types of video capture hardware can compress the 
video during the actual capture process. That is, the hard- 
ware captures, digitizes and compresses all in one step. In 
this case, it is not necessary to use the compression com- 
puters 21. Instead, the captured video segments can be 
written directly to CD-ROM 10. 

Compression algorithms that allow video to be captured 
and compressed in real time are called symmetrical algo- 
rithms. That is, the time needed to capture and compress is 
the same as the time needed to decompress and display on 
a computer screen. The Motion Picture Experts Group 
(MPEG) algorithm is an example. There are a variety of 
commercially available MPEG capture cards available. 
Compression algorithms that require more time to compress 
than to decompress for playback are call asymmetrical 
algorithms. Intel's Indeo algorithm is an example. The 
advantage of using capture hardware with symmetrical 
algorithms is that the lengthy compression step is elimi- 
nated. The disadvantage is that playback may require a 
special hardware card inserted in the playback PC. Asym- 
metrical algorithms on the other hand allow compressed 
video to be played without a special hardware card. For 
example, Intel's Indeo algorithm plays well on a 486 PC 
without special hardware. 

The ASCII text file received from the court reporter must 
be converted into a format that allows the synchronization 
and viewing software to know the page and line number of 
the text. Page and line number characters are inserted into 
the text by the court reporter's software to be printed out and 
read by an operator. No computerized page and line number 
index is provided with the ASCII file. The present invention 
uses a specially developed software program and process to 
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convert any ASCII file into a Common ASCII File Format 
(CAFF) that can be accessed by a computer using page and 
line numbers. FIG. 5 is an overview of the process and FIG. 
6 is a flow chart of the program. 

Referring to FIGS. 3 and 5, the first step of the process is 
to copy the ASCII file on diskette 6 into the hard disk of 
text/video synchronization computer system 22 (step 122). 
Using a typical text editor such as Microsoft's Write Editor 
or a word processor such as WordPerfect, the text of the 
ASCII file is displayed on the computer screen. The starting 
page number within the text is read by the operator (step 
124). (Some transcripts are continuations of earlier testi- 
mony and do not start on page 1 .) The number of lines per 
page can be determined by scrolling down through the text 
and observing the maximum line number inserted by the 
court reporter. The starting page and line numbers are 
recorded on an ASCII Conversion Sheet (step 126). Also, if 
the ASCII file contains time code or SMPTE code 
information, the column number location of such data is 
recorded. FIG. 10 (described further below) shows an 
example of such a sheet. At the same time, if there is any 
extraneous information at the beginning or end of the ASCII 
file, such as court reporter address, such' information is 
deleted using the text editor (step 128). It is important to 
preserve all text in the body of the rile since deleting any text 
causes page and line numbers to be incorrect. Using the text 
editor, the left most column for the start of text for each line 
of testimony is determined by scrolling down through the 
text (step 130). The text of each line from the court reporter 
software starts in the same column for the entire transcript. 
The output of the text editor is saved as a new file, leaving 
the original ASCII file unaltered. 

Referring to FIGS. 5 and 6, the Transcript Conversion 
Program (CONVERT) is then started (step 132). The name 
of the file saved by the text editor, the starting page number, 
the number of lines per page and the starting column number 
of the text must be entered into the CONVERT program. The 
logic of CONVERT is shown in FIG, 6. CONVERT creates 
the CAFF file for the transcript. A CAFF file has distinct 
lines, each terminated by carriage return and line feed. All 
extraneous headers, footers, blank fines, line numbers and 
page numbers, which are not part of the written testimony, 
are discarded. 

When CONVERT starts, line count is set to one and the 
text file created by the text editor (steps 122-130) is opened 
on input (step 144). The program then scans to the start of 
line one on the first page of the transcript file (step 146). The 
scanning is accomplished by looking for the character "1" 
followed by spaces then text starting in the column number 
supplied, i.e. line one (1). If the first line of the first page 
cannot be found, an error message is printed (steps 148 and 
150) and the programs exits (step 166). If the first line can 
be found, the starting text column number is used to delete 
extraneous characters and spaces and the line number char- 
acters (step 152). Then the program scans the text to find the 
end of line (EOL) (step 154). Once the EOL is located, the 
line count is incremented (step 156) and the line is written 
out to an output file (step 158). If time or SMPTE codes have 
been inserted, such information is extracted and placed in 
the PRES YNC file. The process of locating a line, discarding 
extraneous information and then writing the line to an output 
file continues until the lines per page limit is reached (step 
160). The line count is then set back to one and the program 
begins searching for line one of the next page, disregarding 
extraneous header and footer text (step 162). The process 
continues in the same manner until a "next page" cannot be 
found indicating that the end of the ASCII text has been 
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reached (step 164). The program then closes all files and 
exits (step 166). 

The output of the CONVERT program is the ASCII text 
in CAFF format and optionally a PRESYNC file. The 

5 PRESYNC file contains an entry for each line of the 
transcript. Each entry contains the time or SMPTE code 
information for the line. 

Referring to FIG, 5, once the Transcript Conversion 
Program has converted the ASCII text to a file of distinct 

10 lines without extraneous text, the converted text is loaded 
into the Video and Text Viewer Program (VIDLINK) (step 
134) developed as part of the present invention. The 
VIDLINK program clisplays the text of the converted file 
along with calculated page and line numbers which are 

15 displayed in the left hand column next to each line of text. 
The program uses starting page number and number of lines 
per page to calculate the correct page and line number. It 
keeps track of the current line number of the file being 
displayed and divides that number by the lines per page. 

20 VIDLINK is a Windows program and its window can be 
displayed next to other Windows applications. By loading 
the original text file, using a text editor (step 136) such as 
Microsoft's Write Editor, the original and converted files can 
be displayed side by side (step 138). The operator then scans 

25 through the original text, reading the page and line numbers 
(line -by-line), and at the same time scanning through the 
converted text using the VIDLINK program that computes 
and displays the page and line numbers. The operator 
determines if the converted file matches the original file 

30 (step 140). If it does, the original ASCII file has been 
correctly converted. Otherwise, a new column number is 
used and/or the original text is edited slightly to eliminate 
extraneous text hindering the conversion program and CON- 
VERT is run again (step 142). 

35 Once the VHS tapes are converted to CD-ROM and once 
the original ASCII file is converted to CAFF, the text/video 
synchronization is completed using computer system 22 
shown in FIG. 3 and the LIPSYNC program developed as 
part of the present invention. LIPSYNC is a Windows 

40 program developed using the Microsoft's Visual Basic and 
associated audio and video controls (VBXs). LIPSYNC 
allows the user to play (view and hear) a video while at the 
same time reading text of the associated CAFF file. 
LIPSYNC operates with any compression algorithm, and 

45 associated hardware and software, compatible with 
Microsoft's Windows. LIPSYNC displays video in one 
window while displaying text in another. Special keystrokes 
allow the operator to stop, start, forward and reverse the 
video and allow the operator to scroll up and down in the 

50 text. LIPSYNC displays text using the same page and line 
count logic of the VIDLINK program. That is, text is 
displayed along with the calculated page and line number 
information. By pressing the ENTER key, the operator links 
the current text line highlighted to the current video seg- 

55 ment's frame number. The linking information is stored in a 
SYNC file. 

FIG. 7 shows the procedure for using LIPSYNC. Refer- 
ring to FIGS. 3 and 7, the operator puts on an audio headset 
23 to hear the audio portion of the video and starts 

60 LIPSYNC by supplying a starting page number and number 
of lines per page (step 168). The operator then determines if 
time or SMPTE information is on the original ASCII disk or 
VHS tapes (step 170). If so, processing goes to the steps 
shown in FIG. 8 (described below). Otherwise, the operator 

65 opens the CAFF file and the first video segment (step 172). 
The CAFF file is shown in a text window on a computer 
screen of the computer system 22. The page and line 
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numbers for each line are also shown. The operator's job is 
to associate each line in the text with a frame number on one 
of the video segments stored on the CD-ROMs. The operator 
then starts playback of segment one by pressing the proper 
key and listens to the audio. Once some audio is heard (step 
174), the operator stops the video and then scans the text 
looking for the words heard on the video, advancing the text 
using scroll keys until the words on the video can be seen in 
the text (step 176). There is also a text search function which 
allows the operator to scan the entire text. The operator 
establishes the initial synchronization point for the video and 
the text. The video is at a specific frame number and the text 
is at a specific page and line number. 

The operator then starts the video playback (step 178) and 
listens to the audio while reading the corresponding text in 
the text window. The operator reads the words at the end of 
each line (EOL) and waits for the words to be spoken on the 
video (step 180). When the operator hears the words at the 
end of the line (step 182), ENTER is pressed which causes 
the program to link the text and video by recording the 
current page and line number and frame number in the 
SYNC file (step 184). At the same lime the program auto- 
matically advances to the next line. The process continues 
until the end of the current video segment file is reached at 
which point the video stops (step 186). If there are more 
video segments and/or more CD-ROMs containing video 
segments (step 188), the operator opens the next video 
segment and starts the synchronization process again (step 
190), synchronizing text with video until all video is com- 
plete. When all video files are complete, LIPSYNC writes 
out the SYNC file to diskette 24, and the process is complete 
(step 192). The converted text is also written to the diskette 
24. 

F1G.8 shows the processing steps and use of LIPSYNC 
if there is time or SMPTE code on the ASCII disk 6 and/or 
the VHS tape 3. This process is different than the process of 
FIG. 7. Referring to FIG. 8, the first step is to have 
LIPSYNC open the CAFF file and the PRESYNC file (step 
194). At this point, there are two processing options (step 
196). The first option ("NO" in step 196) is used when the 
ASCII text contains time or SMPTE information but the 
VHS tapes do not have such information (steps 198 and 
200). The second option ("YES" in step 196) is used when 
both the ASCII file and VHS tapes contain time or SMPTE 
code information (step 210). 

For the first option, LIPSYNC is used to open the first 
video segment and locate the initial sync point (step 198), 
just like in steps 174 and 176 of FIG. 7. When the operator 
advances the text file to the initial synchronization location 
(step 198), the operator presses a special key that causes 
LIPSYNC to read the PRESYNC file and make an initial 
version of the SYNC file. The PRESYNC file contains time 
or SMPTE code information for each line of the text. Since 
the VHS tape doesn't contain such data, it is necessary to 
make an initial synchronization of the text and video. Once 
the initial synchronization is done, LIPSYNC fills in the 
SYNC file from the initial point forward (step 200) using the 
time or SMPTE code information from the PRESYNC file. 
The PRESYNC data is correct up to any point where the 
videographer turned off the video camera, causing a discon- 
tinuity in time in the video. Time or SMPTE code informa- 
tion in the ASCII file beyond such discontinuity point will be 
out of synchronization. LIPSYNC provides features that 
allows the operator to locate the discontinuities in the video. 
After the initial sync point is located and the SYNC file filled 
in using data from the PRESYNC file, the operator jumps to 
the end of the testimony and plays the video while reading 
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the synchronized text (step 202). If the text and video is out 
of sync (step 204), the operator does a binary search looking 
for the earliest point of discontinuity (step 206). LIPSYNC 
allows the operator to jump to a specific location in the video 

5 or transcript. The operator jumps from the end of the 
transcript (which was out of sync) to a point half way 
through the transcript. The video and text are played to see 
if they are in sync. If they are, the operator jumps half way 
toward the end of the transcript and checks the synchroni- 

10 zation. If the video and text are out of sync, the operator 
jumps half way toward the beginning. This process contin- 
ues until the first point of discontinuity in the video is found. 
The operator then presses a key to synchronize the text and 
video from that point forward (step 208) using data from the 

is PRESYNC file in the same way that the initial sync point 
was established. The steps of (a) finding an initial sync point, 
(b) going to the end of the transcript and (c) locating points 
of discontinuity, continue until all the points of discontinuity 
have been located and properly resynchronized at which 

20 time the SYNC file is written out. 

For the second option, the PRESYNC file is used to 
automatically generate the SYNC file (step 210) because the 
VHS tape contains time or SMPTE code information which 
can be linked directly to the transcript. The data was saved 

25 in the PRESYNC file during the capture process. For this 
option, LIPSYNC generates the SYNC file (step 210) and 
the operator then checks the results by examining different 
points in the transcript to make sure they are properly 
synchronized to the video (step 202). If an out of sync point 

30 is found (step 204), the binary search operation used for the 
first option is performed to find the point of discontinuity 
(step 206) and to correct it (step 208). 

The output of UPSYNC is a SYNC file that is an index, 
by page and line number of the video information on 

35 CD-ROM 10. There is an entry in the SYNC file for every 
line in the converted transcript. Associated with every entry 
is a video file segment name and the frame number offset 
into the video file (i.e., the frame number that was playing 
when the operator pressed ENTER for the line). 

40 The SYNC file links together each line of a transcript with 
specific frame numbers on the video segment files associated 
with the transcript. To view synchronized video and text, a 
special Windows program, VIDLINK, developed as part of 
the present invention, displays both the text and the video in 

45 separate windows on a computer screen. Using VIDLINK, 
the user imports the text and SYNC files from either diskette 
6, diskette 24 or CD-ROM 10 into the computer's hard disk. 
When the user opens the text file for viewing, the text 
appears in a window on the computer screen. The user can 

50 scroll from one location to another using standard text scroll 
functions. In addition, the user can open a video window for 
displaying the video segments stored on CD-ROM 10. When 
the video window is open, the VIDLINK program uses the 
associated SYNC file to determine the video segment and 

55 frame number offset corresponding to the current location 
(page and line) of the text file. Initially, the still image for the 
identified frame is displayed. The user then has the option to 
"play" the video by pressing a "play" button on the computer 
screen. The video then starts playing and the associated 

60 sound comes out of the computer's speakers. As VIDLINK 
is playing the video, it keeps track of the current video 
segment file and the current frame number. The software 
uses the SYNC file to track the current "sync" point in the 
text and automatically scrolls the text as the video plays. 

65 Alternatively, if the user scrolls through the text, VIDLINK 
uses the SYNC file to determine the current segment and 
frame number and displays the still image associated with 
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any location in the text. V1DLINK also contains standard 
text search features for finding specific text strings. When 
the search function finds a specific string, the program 
moves the video image to the same location. Any computer 
with a VGA monitor can display the video. Since courtroom $ 
projectors are typically attached to VGA monitors, the video 
can also be displayed on a courtroom projection system 32 
(see FIG. 1). The video files are stored on CD-ROMs which, 
in turn, can be stored on CD-ROM changers or jukeboxes 
compatible with Microsoft's standard file I/O system. 10 

The video viewing portion of VIDLINK has an applica- 
tion programming interface (API) that allows other text 
viewing Windows programs to add the synchronized video 
capability. The video viewing software runs as a separate 
Windows application. The API provides communication 15 
between the video viewing application and other text view- 
ing applications. Software commands are exchanged 
between the two applications. Commands from the text 
viewing software to the video viewer include the following 
two commands: 20 

OPEN (open the SYNC file associated with the text file 
currently being displayed) 

GO TO (move the still image window to the frame 
associated with a specific page and line of the text) 
Commands from video viewing software, to the text viewing 25 
software, include the following command: 

GO TO (scroll the text location to the specified page and 
line number) 

Other commands are used to coordinate which text and 
SYNC files are open, to import SYNC files into the system, 30 
and to launch and close the video application. 

An example of this API is the interface between VidLink 
and the transcript viewing software LiveNote. 

It is also within the scope of the present invention to 
create the video product 26 of an event in real-time or from 35 
a prerecorded version of the event. 

FIG. 15 shows a system level diagram of this alternative 
embodiment. This alternative takes advantage of (a) new 
CAT software that can generate the equivalent of a CAFF 
file in real time (for example LiveNote for Windows) (b) 40 
video capture hardware and software that can capture, 
digitize and compress a video signal in real time and (c) 
advances in SCSI device technology that allow a single 
computer to be configured with both a CD-ROM recorder 
and several gigabytes of hard disk space. For this alternative 45 
embodiment, a single PC 42 is configured with Real Time 
Transcription software 43 which of creates the equivalent of 
a CAFF file in real time, and Real Time Video Capture 
Hardware and Software 44 for capturing and storing video 
on the PC's hard drive. An example of this hardware and 50 
software is OptiVision's video capture hardware and soft- 
ware. Since the digital information is compressed, a local 
hard drive has enough room to store the video for one day 
of testimony. A 6 gigabyte local drive (for example, an 
internal SCSI drive) can easily hold eight hours of com- 55 
pressed digital video information. 

For this alternative, the court reporter uses a stenograph 
machine 4 to record testimony. The output 47 of the steno- 
graph machine 4 is sent to the PC 42 where it is converted 
into the equivalent of a CAFF file and stored on the PC's 60 
local hard drive by the Real Time Transcription Software 43. 
The testimony is either live (block 34 in FIG. 15) or is 
played back from a VHS tape recording 35 of prior testi- 
mony using a video tape recorder 36 (block 38 in FIG. 15). 
For live testimony 34, the court reporter listens to the spoken 65 
testimony in real time while a video camera 1 records the 
testimony. For prerecorded testimony 38, the court reporter 
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watches a TV screen 37 while listening to the prerecorded 
testimony. In either case, the video information (either the 
output 39 of the video camera 1 or output 40 of the video 
recorder 36) is sent to the PC 42 to be captured, digitized, 
compressed and stored on the PC's 42 local hard drive. 

The PC 42 contains Real Time Voice Sync Software 45, 
similar to the software developed for the Voice Sync Process 
(element 9 in FIG, 1) which has an interface to the Real Time 
Video Capture Hardware and Software 44 and an interface 
to the Real Time Transcription Software 43. The Real Time 
Voice Sync Software 45 continuously reads the output of the 
Real Time Transcription Software 43. At the same time, it 
continuously reads the output of the Real Time Video 
Capture Hardware and Software 44. This allows the Real 
Time Voice Sync Software 44 to generate a page and line 
number index of the video information. This index is gen- 
erated in real time and is stored as a file on the PC's local 
drive. At the conclusion of the testimony, Video Transcript 
Creation Software 46 writes the transcript and associated 
SYNC file to a diskette 24, and writes the video information 
to one or more CD-ROMs 10. The transcript and SYNC files 
are identical in format to the transcript and SYNC files 
created by the Text Conversion Process (element 8 of FIG. 
1) and the Voice Synchronization Process (element 9 of FIG. 
1). Together, the diskette 24 and CD-ROMs 10 comprise a 
video product 26 identical to the video product 26 created in 
FIG. 1. 

Special control functions in the Real Time Voice Sync 
Software 45 and the Video Transcript Creation Software 46 
provide the ability to start and stop the live recording of 
video, for instance when there is break in testimony. This 
allows the compressed digital video information to be bro- 
ken down into several smaller segments in a manner similar 
to the way the VHS Tape Conversion Process (element 7 in 
FIG. 1) breaks video into segments. Segments are created 
whenever there is a break in the testimony, or when the 
operator of the system determines that a new segment must 
be started (i.e., the equivalent of changing a VHS tape). 
Section V-Operations Manual 

The manual presumes that the process of creating the 
synchronized product is performed by a service company for 
a particular client wherein the creation of the product is a 
"Project." There would be no "client" if the process is 
performed in-house. However, the appropriate identifiers are 
still used. In the example below, the client's name is 
"CLIENT". 

This manual was written for a specific compression 
technology, Intel's Indeo 3.2 compression, and associated 
capture, compression and editing tools. These tools include 
VIDCAP, a software program for capturing video; 
VIDEDIT, a software program for editing and compressing 
video; and Corel CD- Creator, a software program for writ- 
ing a video file to CD-ROM. The video files for the Indeo 3.2 
compression all have the AVI file extension which is 
Microsoft's audio video interleave file format. Other video 
file formats and associated extensions compatible with Win- 
dows and the audio/video controls of Microsoft's Visual 
Basic could also be used. A similar manual would be created 
for other compression technologies such as MPEG com- 
pression. In that case, the capture, compression and editing 
tools would be those associated with MPEG. 

The manual was written for an operation wherein no 
PRESYNC file and associated data is available on the ASCII 
diskette or VHS tape. 



12/22/2003, EAST Version: 1.4.1 



5,832,171 



17 

Table Of Contents 



18 



10 



1.0 Overview 

1.1 System Configuration 

1.2 Operational Overview 
2.0 Tracking projects, tapes, video files and ASCII files 

2.1 Directories and File Naming Conventions 

2.2 Physical Storage Of Project Material 

2.3 Project Log and Processing Sheets 

2.3.1 Project Sheet (FIG. 9) 

2.3.2 ASCII Conversion Sheet (FIG. 10) 

2.3.3 Audio and Video Settings Sheet (FIG. 11) 

2.3.4 Video Processing Sheet (FIG. 12) 

2.3.5 LIPSYNC Processing Sheet (FIG. 13) 

2.3.6 Quality Control Check Off Sheet (FIG. 14) 

2.4 Logging and storing tapes and disks 
3.0 Steps For Converting An ASCII File 
4.0 Capturing RAW Segments 

4.1 Loading The VHS Tape and Starting VIDCAP 

4.2 Setting Audio and Video Levels For A Tape 

4.2.1 Setting The Audio Levels 

4.2.2 Setting Video Level Steps 

4.3 Capturing Raw Segments 

4.3.1 Set up the capture file 

4.3.2 Setting the proper capture parameters 

4.3.3 Starling the capture. VIDCAP/Capture/Video 

4.3.4 Capturing the next segment 

4.4 Determining The Proper Length Of A Segment 

4.4.1 Segment Lengths For Enhanced Conversion 

4.4.2 Segment Lengths For Direct Conversion 
5.0 Compressing each raw segment 
6.0 Writing The CD-ROM 

6.1 Creating A Jewel Case Cover 
7.0 Doing the Lip Synchronization 

7.1 Overview 

7.2 LIPSYNC Operating Procedures 
8.0 Quality Control (Check Off Sheet-FIG. 14) 
9.0 The Finished Product 
10.0 The VHS Tapes and Diskettes 

1.0 Overview 

The material in this manual is inter-related. 

1.1 System Configuration 

The video processing system of the present invention 
includes three or more PCs connected by a local area 45 
network (LAN). Each of the PCs runs Microsoft's Windows 
For Workgroups (WFW) and can access the files on the other 
PCs. 

One of the PCs is a Capture PC. The other PCs are 
Compression PCs, The Capture PC is configured with a 50 
video capture card, a CD-ROM writer and several gigabytes 
of disk storage. The Compression PCs contain a single hard 
drive. 

The Capture PC contains several 2 gigabyte hard drives. The 
drives are designated d:, e:, f:, etc. The hard drives are 55 
accessed by the Compression PCs via WFW. The drive 
letters on the Compression PCs may not be the same as the 
Capture PC. For example, drive e: on the Capture PC may 
be drive f: on the Compression PC. 

In addition to the Capture PC and Compression PCs, there 60 
are one or more General Purpose PCs. One of the general 
purpose PCs has a printer attached. The general purpose PCs 
are used for: 1) processing deposition text, 2) performing lip 
synchronization, and 3) printing jewel case (CD box) covers. 
The Capture and Compression PCs contain very high speed 65 
Intel Pentium microprocessors or equivalents. The General 
Purpose PCs are Intel 386/486 machines or equivalents. 
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1 .2 Operational Overview 

The following processing steps are performed to convert 
VHS tapes to CD-ROMs and to link the video to text of the 
deposition. 

(a) Tapes and disks received are logged in and project files 
are set up. 

(b) The ASCII files are converted to a format that can be 
read (imported) into LiveNote and can be used by the 
LIPSYNC program. The conversion is normally 
accomplished on one of the General Purpose PCs. 

(c) Each set of video tapes for a deposition is digitized and 
read into the Capture PC using the video capture card. 
Normally, each tape is separated into several 20 minute 
or less segments, see 4.4 for information on segment 
size. When first captured, the segments are stored as 
Raw files in the Capture PC. The raw files are stored on 
the Capture PC's drives d:, e:, f:, etc. 

(d) Each Raw file is compressed down to a smaller 
compressed file, if desired. This compression is per- 
formed by the Compression PCs and the Capture PC. 
The Compression PCs access the raw files on the 
Capture PC via the network. Both the raw and com- 
pressed files remain on the Capture PC which has a CD 
writer attached to it. 

(e) All of the compressed files for a deposition (this could 
be from several tapes) are written to one or more 
CD-ROMs on the Capture PC. 

(f) Using the CD-ROMs and the converted ASCII text, 
LIPSYNC is run on the General Purpose PC to syn- 
chronize the text and video. 

Due to the limitations of the amount of disk space needed to 
store all of the files for a deposition, the process of capturing, 
compressing and writing to CD-ROM is separated into 
several batches. 

2.0 Tracking projects, tapes, video files and ASCII files. 
Each job for a client is called a Project. Anew Project name 
is established whenever a new set of tapes and/or disks is 
received. The name can be up to eight alpha characters long 
(no numbers are allowed). The first name of a law firm's 
name is normally used. For instance a project for CLIENT 
might be "CLIENT." Since there may be several jobs for a 
client, the project name further includes a number, for 
example, CLIENT.001, CLIENT.002, etc. 

The project name and number is used to create a subdirec- 
tory on all disks of the Capture PC and the D: drive of the 
General Purpose PC. The name of each subdirectory is the 
project name and number. For example, if drives D:, E: and 
F: are used for the CLIENT.002 project, then a subdirectory 
with the name CLIENT.002 would be created on each of the 
drives. The subdirectory is off the root and the subdirectories 
are used to store the video files (Raw and Compressed). 
An identical project subdirectory is set up on the General 
Purpose PC D: drive, for example, D:\CLIENT.001. The 
directory is used to store all ASCII files (*.ASC), Deposition 
files (*.DEP), text files (*.TXT) and sync files (*.SYN and 
*.SCD). A subdirectory called LETTERS is used for all 
correspondence files such as letters and receipt notifications. 
Depositions within a project are assigned a two digit number 
starting at 01 and going to 99. If there are more than 99 
depositions, the project must be separated into two projects. 
Each deposition is further separated into several video 
segments as previously described. 

2.1 Directories and File Naming Conventions 

Project subdirectories off the root are defined using eight 
alphas and three digits, for example, CLIENT.001. An 
example of a project's subdirectory and file organization is 
as follows: 
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On The Capture PC 

D:\CUENT.001 Video directory for the project on 

the capture PC drives. 

E:\CLIENT.001 

F:\CLIENT.001 

G:\CUENT.001 

DnnSmm[RW or CM] .AVI Video file names. Where nn is 
the deposition number, mm is the 
video segment number for the 
deposition, RW means Raw, CM means 
compressed and AVI is the file 
extension for all MS VFW files. 

On The General Purpose PC 



D:\CUENT.001 
DnnORIG.ASC 
DnnORIG.TXT 

DnnCNVT.TXT 

Dnn.DEP 

Dnn.SYN 
Dnn.SCD 



\LETTERS 

RNO.DOC 
INVDOC 

LETTERn.DOC 
INVOICEn.DOC 



Holds all ASC, TXT, DEP and SYN 
files 

Copy of original ASCII file for the 

deposition number nn. 

Copy of original ASCII file after 

being pre-processed using the text 

editor and saved as a TXT file. 

Output of the Transcript Conversion 

program (CONVERT) which used 

DnnORIG.TXT as input. 

Copy of the deposition processing 

file created and used by the 

LIPSYNC program. 

Copy of the sync file created by 

the LIPSYNC program. 

Copy of the Smart CD sync file 

created by the LIPSYNC program. 

This file is used by systems that 

have a CD-ROM changer and Smart CD 

software. The sync information is 

identical to the *.SYN file except 

the path to each video segment 

contains the volume name of each 

CD-ROM. This allows all CD-ROMs to 

be configured as a single disk 

drive with different paths to each 

physical CD. 

Holds all correspondence to clients 

Receipt notification 

Return notification - inventory 

sheet 

Copies of all letters, n «■ 1-9 
Copes of all invoices, n = 1-9 
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2.2 Physical Storage Of Project Material 

A file cabinet drawer or drawers are assigned to each project 
to hold all the tapes and disks. The name of the project is put 
on each drawer. 

2.3 Project Log and Processing Sheets 

A project log is maintained. The log is a three ring binder 
that contains special processing sheets for each project. The 
sheets are described below. Blank copies of the sheets are 
provided on the following pages. 
2.3.1 Project Sheet (FIG. 9) 

Used lo establish a project name (e.g. CLIENT.001) and to 
establish a number for each deposition in the project. The 
Project Sheet includes the following information: 
Name of Project 

Shipment Received-Enter date all tapes and disks 
received 

Receipt sent-Enter date Receipt Notification sent to client 
All originals sent-Enter date when all original tapes and 

diskettes have been sent back to the client. 
All CD-ROMs-Enter date all CD-ROM *.TXT, *.SYN 
and *.SCD files sent and invoice has been issued. 
For each deposition in the project enter the following 
information: 

Last name of deponent 

Number assigned to this deposition 
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Number of tapes for the deposition 

Name of the ASCII file or files received. 

Date the original material was received 

Date the original material sent back 

Date the CD-ROM TXT, SYN and SCD files sent 
Use additional project sheets as required if there are several 
depositions. Fill in the Page_of_area. 

2.3.2 ASCII Conversion Sheet (FIG. 10) 

The ASCII conversion sheet is used to record the following 
information about the conversion of each ASCII file 
received for a deposition: (In some cases, more than one file 
must be merged together using the text editor. In this case, 
use a separate line for each file name.) 

Deposition Name-Enter last name of deponent 

Nmbr-Enter deposition number 

Org ASC-Enter original ASCII file name. 

(DnnORIG.ASC) 
Orig TXT-Enter original TXT file name (output of the text 

editor process) (DnnORIG.TXT) 
Cnvrtd TXT-Enter the converted TXT file name 

(DnnCNVT.TXT) 
Enter the Lines per page, starting page number, column 

number used when converting, date converted and any 

comments regarding the conversion. 

2.3.3 Audio and Video Settings Sheet (FIG. 11) 

The Audio and Video Settings Sheet is used to save the 
following video/audio settings for each tape. 
Audio Settings-For each tape, fill in the Master (M), 
Treble(T), Bass (B) and Line ln(L) settings. Note: 
MIDI, WAV and Speaker should normally be set to five. 
Video Settings-For each tape, fill in the Contrast(C), 
Tint(T), Saturation(S), Brightness(B) and Crop (CP) 
settings. 

Note: See section 4.0 for instructions on filling values for 
audio and video settings. 

2.3.4 Video Processing Sheet (FIG. 12) 

There are one or more video processing sheets maintained 
for each deposition. The Video Processing Sheets are used to 
keep track of the batches of video segments, the individual 
raw and compressed files and the number and size of files 
needed to fill out a CD-ROM. Each sheet includes the 
following information: 
Project/Deposition Names- fill in the project and deposi- 
tion name and number. If more than one sheet is 
needed, fill in the Sheet of area for each new sheet. 
Tape Number (TN)-As each tape is processed, fill in the 
tape number. Note: For each new tape, an entry must be 
made in the Audio and Video Settings Sheet. 
Segment Number-This is the DnnSmrn number for this 
segment. 

Tape Deck-Fill in the tape deck counters for the start and 
stop of each segment as it is captured. These are used 
to redo a capture session. 

Capture-Fill in the number of minutes captured, the size 
of the capture file, the number of frames in the capture 
file and the capture PC drive letter used, e.g. E, F, G or 
H. 

Compression-Fill in the Processing unit that is used to do 
the compression (ZEOS 1, DELL, etc.) and the final 
compressed size (in megabytes) of the compressed file. 
Also fill in the amount of time it took to compress the 
file. 

Writing CD-ROM. Fill in the CD-ROM number (e.g. 
CLIENT023), the date/time the CD-ROM was written 
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and enter a check mark when each video file has been 
checked using the media player and purged from the 
compression PC drive (along with the raw file). 

Comments 

2.3.5 LIPSYNC Processing Sheet (FIG. 13) 
The LIPSYNC Processing Sheet is used to track the progress 
of the LIPSYNC operation for a deposition. One sheet is 
used for each deposition. At the top of the sheet is general 
information about the deposition. This includes: 

Project Name-Enter project name and sheet number, if 
required. 

Deposition Name and Number-Entered as each new depo- 
sition is started. 15 

.TXT File-Name of the .TXT file used 

.DEP File-Name of the DEP file created 

SYN File-Name of the SYN file created. Note: the SCD 
file will be given the same name by the system. 
For each video file (segment) on the CD-ROMs for the 20 
deposition, the following information is recorded: 

CD-ROM Nmbr-The number of each CD-ROM as it is 
processed 

File Nmbr-The file number of each file as it is processed. 2 5 
This file number is assigned by the LIPSYNC program. 

Starting page and line number for the file 

Ending page and line number for the file 

Date and time the synchronization was completed for the 
file. 

2.3.6 Quality Control Check Off Sheet 
The Quality Control Check Off Sheet has two functions, 
First, it is used to track the actual importing of the TXT and 
.SYN files into VIDLINK and to make several checks of the 
CD-ROM, the TXT file and the .SYN file. The following 
information is recorded in the top block: 

Project Name -Name of project and sheet number if 
required. 

Date (MM/DD/YY) 40 
Deposition Name and Number 

Test Check offs. Check each block when the test is 
complete: 

(a) .TXT-Imported the TXT file into VIDLINK 

(b) .SYN-Imported the SYN file into VIDLINK 

(c) Last Lines Compared-Use WRITE to bring up the 
original ASCII file and then compare the last page/line 
number in the original with the page and line number 

of the VIDLINK file. 50 

(d) Random Compares are OK-Compare various page/ 
line numbers of the original with the VIDLINK tran- 
script. 

(e) Random Play is OK-Pick random points in the tran- 
script and play the video. Make sure each CD-ROM is 55 
loaded. 

Then, the next section is used to check the transition points 
between each video file. The location of each transition point 
is first determined and then VidNote is used to "play across'* 
each transition point to make sure it is smooth and without 60 
errors. 

The length, in minutes, of each file (segment) is first entered 
for each file. The times were display when LIPSYNC was 
used to create the SYN file. When SYN file was created, the 
individual times were written on this sheet. 65 
Using the individual file lengths, the cumulative or running 
time of each transition can be calculated. Each transition can 
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then be examined in VIDUNK by advancing the deposition 
to a point in time a few seconds before the transition and 
then playing the video across the transition. 
Note that the VIDLINK slide bar is set to seconds instead of 
percent of tape. 

CD-ROM Nmbr-The number of each CD-ROM as it is 
processed 

File Name -The file number of each file as the transition at 
the end is examined. 

File Length-Length of each video file in hours, minutes, 
and seconds to the hundredths place. 

Cumulative Length-Sum the file length columns as Vid- 
Note will show the cumulative time into the deposition 
video. Transition playback check off. Check if the 
transition appears OK. 
2.4 Logging and storing tapes and disks. 

If not already done, set up physical files and computer 
files for the job. 

Log in receipt of tapes and ASCII disks on the Project 
Sheet (FIG. 9). Send back a Receipt Notification, put a 
copy in the Project Log, and store the file in the 
\LETTERS area of the general purpose PC. 

Assign a deposition number to each deposition in the 
project. Use the convention D01, D02, etc. There will 
be a deponent name and date (of the beginning of the 
deposition) for each deposition number. These are 
listed on the Project Sheet. 
3.0 Steps For Converting An ASCII File 
Load the original ASCII file into the project file area of the 
General Purpose PC, e.g. D:\CLIENT.001 \D01 ORIG.ASC. 
Use the file extension ASC, the deposition number and 
ORIG to denote original. For example D01 O RIG. ASC. 

Use the text editor to look at the file to determine the 
number of lines per page, the starting column for the 
text and the starting and ending page numbers. Some of 
the beginning pages and ending pages may be deleted 
if they contain junk. Do not delete any text in the 
middle of the files, since such deletions causes page/ 
line numbers to be incorrect. Save the new file with the 
TXT extension, for example, D01 ORIG.TXT Write 
the page, line and column numbers in the Processing 
Log. 

Note: Deposition ASCII files normally have page num- 
bers at the top right with line numbers typed along the 
side. Indented from the line numbers will be the actual 
text. The Transcript Conversion Program (CONVERT) 
program strips out all page and line numbers and 
arranges the text as single, distinct lines, the format 
required by VIDLINIC CONVERT needs to know the 
column number of the start of the actual text. Try to 
determine the column number of the column just to the 
right of the text. Scan down in the transcript to make 
sure the column is blank all the way to the bottom of the 
transcript. 

Use the Transcript Conversion Program (CONVERT) to 
convert the TXT file to CAFF format. Use TXT as the 
file extension for the output file along with CNVT, for 
example, D01 CNVT.TXT Once the file has been 
converted, import the file into VIDUNK and view the 
original file (.ASC) using WRITE and the converted 
file using VIDLINK to make sure the page and line 
numbers are correct. Go to the end of each file to make 
sure everything is correct. If there are problems, adjust 
the starting column number and/or delete junk text at 
the beginning or end. Do not delete text in the middle 
of the file. 
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4.0 Capturing RAW Segments 

Normally, each raw segment should be about 20 minutes 
long, see Section 4.4. However, the raw segment needed to 
"fill out" the end of the 640 MB CD-ROM will be less than 
20 minutes. See 4.4 below for details. The raw segments are 5 
stored in the project subdirectory on Capture PC disks, e.g. 
E:CLIENT.001\D01S01RW.AVI. 

4.1 Loading The VHS Tape and Starting VIDCAP 

Load the VHS tape into the tape deck and start VIDCAP. 
Play a few minutes to make sure the video looks fairly good. 10 
Rewind the tape to the beginning and advance past any junk. 
When capturing, the video quality (using VIDCAP controls) 
and audio quality must be adjusted by following the steps 
described below. 

Once the audio and video levels are set, save the settings for 15 
the video tape. The settings should be good for the entire 
tape. There will be a new set of settings for each tape. 

4.2 Setting Audio and Video Levels For A Tape 

The audio and video levels must be set once for each tape. 
The levels are recorded in the Audio and Video Settings 20 
Sheet (FIG. 11). 

4.2.1 Setting The Audio Levels 

First, press play on the VCR. Then go into the VidCap 
program. You should see and hear the video. Follow these 
four steps to set the audio level: 25 

1. VIDCAP/OPTIONS/AUDIO FORMAT/LEVEL. 
Move the recording level window over to the side. 

2. Bring up the Creative Mixer window using Alt Tab to 
go into the Program Manager. 3Q 

3. Adjust Master, Bass, Treble and Line In. Record the 
settings in the Audio and Video Settings Sheet. Save the 
settings on exit. The settings will probably be OK for 
the entire tape. New settings will be required for the 
next tape. To determine the numeric value of a setting, 3S 
assume each horizontal line on the slide bar is one unit. 
When the slider is at the bottom, the setting is zero. 
When the slider covers the bottom line, the setting is 
0.5. When the slider is on top of (sitting on) the bottom 
line, the setting is 1.0 and so forth up to a maximum AQ 
value of 7,0. 

Adjust Master and Line In so that the audio quality is 
pleasant and the Record Level (from VIDCAP/ 
OPTIONS/AUDIO FORMAT/LEVEL) indicator never 
goes further than two thirds of maximum. 45 
Note: Midi and WAV should be set to five. They are not 
used on input. Also, Speaker output is normally set to 
5. The value may be changed during video playback. 

4. Press OK on Preferences, Recording Level, Audio 
Format. 50 

4.2.2 Setting Video Level Steps 

1. Reduce the overall size of the VIDCAP window to be 
tight around the video window. Move VIDCAP (and 
the video window) to the lower right hand corner. ^ 

2. Go to Option/Video Source and move the window to 
the upper left so that you can see the controls and video 
at the same time. 

3. Play the video, adjust the settings and SAVE the 
settings in the Audio and Video Settings sheet (FIG. 60 
11). The settings will probably be used for the entire 
tape. 

4. Crop the video, if necessary. If the videographer 
maintains a close up view of the person providing 
testimony, crop is not needed. Otherwise, increase the 65 
crop level to 5 or 6. Do not delete date/time display. Do 
not cut off the person's head or other important areas. 
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Also, remember that a good videographer will periodi- 
cally pan in an out on the person giving the deposition. 
If you crop the picture tightly when the videographer 
has panned out, then the head will be cut off when the 
videographer pans in. 

5. Set Brightness, Contrast, Tint and Saturation. Keep 
Saturation as low as possible. 

6. Save the settings. Write the levels on the Audio and 
Video Settings Sheet (FIG. 11). 

4.3 Capturing Raw Segments 

Normally several raw segments are captured in a batch of 3 
to 4 segments. Capture one segment right after another, 
pausing only to set up a new capture file. When the batch of 
captured segments is complete, compress all the raw files in 
the batch and move them on to CD-ROM to free up disk 
space so that another batch of raw segments can be captured. 

4.3.1 Set up the capture file. 

Set up the output file by using VIDCAP/FILE/SET CAP- 
TURE FILE. Use the following file name convention for the 
raw files. D01S01RW.AVI, D01S02RW.AVI, etc. Make sure 
the capture file size is greater than 1 0 Mbyte and that there 
is enough disk space on this drive for the new Raw file. Most 
of the time it will be. Make sure you have enough disk space 
for the capture file. See 4.4 below. 

4.3.2 Setting the proper capture parameters. 

Use the following steps for the captured parameters: 
VIDCAP/Options/Audio Format use 8 bit, 22 khz and 
mono. 

VIDCAP/Option/Video Format use Indeo RAW with a 

size of 240X180 (note, this should be the default) 
Video compression should say No Recompression. 

4.3.3 Starting the capture. VIDCAP/Capture/Video 

1. Set the proper capture parameters 
Frame rate-15 FPS 

Disable the capture time limit (use one of the egg 
timers) 

Capture Audio and Capture to disk 
Recheck audio, video and compression settings from the 
menu. 

2. Move the video window to the center of the screen 

3. Start the capture by clicking on OK. You will receive 
one additional OK that displays the capture file name. 
Press Play on the VCR to start the video. The moment 
you see a clear picture, press Enter on the final OK. The 
capture should start and frame and second counts will 
appear. 

When the capture has just begun, watch the capture window 
for a few moments to make sure no frames are being 
dropped. If any frames are being dropped, the hardware 
needs to be reset. Stop the tape and rewind it to the same 
starting point (use the VCR counters). Exit out of VidCap 
and Windows. Reboot the computer and start all over. If 
frames are not being dropped, let the capture continue on. 
Check your watch or set an egg timer. You will normally 
capture approximately 20 minutes. See 4.4 below. You must 
try to stop the raw capture at a lull (one or more seconds) in 
the conversation. To stop the capture, wait for a lull, press 
ESC (this will stop the capture) and then press stop on the 
VCR. Press the VCR PAUSE button (not the STOP button) 
slightly after stopping the capture. Since you are in a lull in 
the conversation, you are eliminating a small amount of 
silence. 

If you are toward the end of the tape and you hit the end 
before 20 minutes, press ESC to stop the capture. 
Keep and eye (and ear) on the tape when capturing to make 
sure you stop capturing (by pressing ESC) if you hit the end 
of tape or the video stops. 
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No frames should be dropped (zero frames dropped). 
When you PAUSE the tape, leave it at the same position for 
the next raw capture (unless you are at the end of the tape). 
The VCR will hold the PAUSE position for about 120 
seconds, plenty of time to set up the next raw capture. In the 5 
final raw capture for the batch, let the VCR go to the STOP 
position, which it will do automatically after about 120 
seconds. 

4.3.4 Capturing the next segment 

To capture the next segment on the tape, simply select a new ]Q 

capture file by using FILE/SET CAPTURE FILE with a new 

RAW file name. All the settings remain the same. Normally 

you can do this quickly, while the tape is PAUSED. 

You will capture several segments in a batch and then 

compress the segments to free up disk space. In the last 

segment of the batch, STOP the VCR at its current location, 15 

which will be the starting point for the next batch. 

4.4 Determining The Proper Length Of A Segment 

The length of a raw segment is a function of the following 

factors: 

The amount of disk space available. Normally disk space 20 

has been freed up by the compression process. 
The estimated number and size of the segments needed to 

fill up the next CD-ROM. 
The estimated time left on the current tape. The PC to be 25 

used to compress the segment. Some PCs are faster 

than other. 

4.4.1 Segment Lengths For Enhanced Conversion 

For enhanced conversion, the CD-ROM can hold about 81 
minutes of video. With three fast compression PCs and one 3Q 
slower capture PC (slower for compressing) the ideal mix of 
segments is three 22 minute segments and one 15 minute 
segment, which add up to 81 minutes. 
For enhanced conversion, 81 minutes will take up about 3.7 
GB of disk space for the raw files and about 633 MB of 
space compressed. The CD-ROM can hold up to 640 MB. 35 

4.4.2 Segment Lengths For Direct Conversion 

A CD-ROM can hold about 120 minutes of video. Thus, use 
four thirty minute segment of video. Segment links for direct 
conversion should be thirty minutes. 

5.0 Compressing each raw segment. 40 
The raw files for a batch will be on the Capture PC's disks. 
The raw files must be compressed before they are stored on 
CD-ROM. The Compression PCs and the Capture PC can be 
used to compress the raw files. 

VidEdit is used to compress a raw file. Start VidEdit on each 45 
of the Compression PCs and Capture PC. Follow these three 
steps for each PC. 

1. Open the raw file using FILE/OPEN. Make sure to select 
the proper file. Ttie Compression PCs will compress files 
physically located on the Capture PC, e.g. drives d:,e:, etc. 50 

2. Do File/Save AS from the VidEdit menu. 

Use the DnnSmmCM.AVI name convention, e.g. D01 
S01 CM AVI 

Using Compression Options, select Intel Indeo, Video 3.2. 

Normally this can be done by selecting the "Default". 5S 
Under Details use the following 



Category 


For Direct 


For Enhanced 


Data Rate 


65 K 


130K 


Interleave 


Audiol frame 


' 1 frame 


Key frame every 


4 frames 


4 frames 


Pad frames for CD playback 


yes 


yes 


Video Quality 


100 


100 



60 



65 



Note: By selecting the Default, most of these setting will be 
correct. Make sure to set all settings. 



3. Start the compression by clicking OK. Check the number 
of frames being compressed per minute to estimate the 
length time to compress the raw file. 

6.0 Writing The CD-ROM 

Once all of the raw files have been compressed for a batch, 
they are written directly to CD-ROM (if there is enough 
space to fill out the 640 Mbytes of the CD-ROM). 
Start Corel CD Creator on the Capture PC. 
Under DISC, create a subdirectory on the CD called 
VIDEO which holds the compressed video files. High- 
light the VIDEO directory to add the files to the 
directory and not to the root of the CD-ROM. 
Use Add Items up to 640 for selecting the video files to be 
copied. 

Mbytes per CD. Try to have around 630 Mbytes. Use 
Browse to change the drive letter. 

Go to FILE/CREATE CD -FROM LAYOUT and select the 
following settings 

Write speed is 2x1 50K 

Write protect on 

Single track on 

Set a volume name of {project name}nnX where nn is the 
deposition number and X is the CD-ROM number for 
the deposition (X-l-9). For example CLIENT018. If 
there are more than 9 CD-ROMs for this deposition, 
use letters of the alphabet starting at A after number 
"9". For example CL1ENT01C would be the 12th 
CD-ROM for deposition number 01. 
Set the Disc Title to the deposition name by selecting Disc 

Properties and then the Disc Title field. 
Always use a two digit deposition number even if you 
have to fill in a leading zero. 
Project name is never larger than 8 characters so there are at 
most 11 characters. Also, project names always contain 
alpha characters so you will always know where the depo- 
sition number begins. 

You will normally make one copy. 
Click on "create CD-ROM" and watch for any error 
messages. 

When the "writing CD" message comes up, you can leave 
it alone for about 20 minutes. You can create and print 
a jewel case cover while you are waiting. 

When done, check that there are no error messages. 

Insert the jewel case cover into the jewel case. 
At this point, it is very important to check the quality of the 
CD-ROM. Occasionally, the CD-ROM will not operate 
properly and it should be rewritten before deleting the 
compressed files. Place the CD-ROM in a CD-ROM drive 
on the capture PC (not the CD-ROM writer). Use the Media 
Player to play each video file on the CD-ROM. Play each file 
at the beginning, middle and end. 

Once you are sure that the files on the CD-ROM are OK, 
delete the compressed files and any remaining raw files. 

6.1 Creating A Jewel Case Cover 

Use WordPerfect to create a Jewel Case cover. There is a 
standard form, JEWELBOX.FRM, stored in the D: of the 
general purpose PC. Bring up the form, modify it for the 
current CD-ROM and deposition and print it out. Save each 
WP file for each jewel box cover in the \LETTERS directory 
for the project. Instructions for cutting the form down to 
jewel case size are printed on the bottom of the form. 
7.0 Doing the Lip Synchronization 
The LIPSYNC program is used to link together the video 
and text. It is the last step in the process of creating 
synchronized video and text. Prior to running the LIPSYNC 
program, the following steps must be complete: 
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Captured and compressed enough of the video to have at 
least one CD-ROM. You will have created AVI files 
called DnnSmmCM.AVI, etc. 
Written the DnnSmmCM.AVI files to one or more 

CD-ROMs using the Corel CD Writer. 5 
Converted the ASCII text files to a single DnnCNVT.TXT 
file for the entire deposition. Make sure you know the 
starting page number of the DnnCNVT.TXT file and 
the number of lines per page. 
Use the LIPSYNC program to link the compressed video 1 
files on the CD-ROMs (one or more CD-ROMs) to the 
DnnCNVT.TXT file. 
71 Overview 

The LIPSYNC process can be started before all the 
CD-ROMs have been created. The LIPSYNC program links 15 
frame information on the CD-ROMs with page and line 
number information in the converted ASCII file. 
When first starting the LIPSYNC program, you have to tell 
the program the name of the converted ASCII file and the 
names of the CD-ROMs that are available. All the informa- 
tion is stored by LIPSYNC in a deposition file or DEP file. 
The DEP file contains all the LIPSYNC information. 
Normally you will perform lip synchronizing in several 
sessions as CD-ROMs become available. In the first session 
create the DEP file and start adding LIPSYNC information. 25 
At the end of the session, make sure you save the DEP file, 
since it contains all of your work to date. 
To start a new session at a latter time, just load the .DEP file 
back into LIPSYNC and continue on, doing more of the ^ 
synchronization. Be sure to save your work in the .DEP file 
at the end of each session so that you can start your next 
session at the same point you left off. The LIPSYNC 
program will warn you to save your work. 
After all the lip synchronization is completed, create a 
special file called a .SYN file. The .SYN file will be 
IMPORTED into VIDLINK and it contains the actual sync 
data you created. 

7.2 LIPSYNC Operating Procedures 

1. Start the LIPSYNC program by double clicking on the ^ 
LIPSYNC icon. If you are beginning a new deposition, d0 
create the new *.DEP file by doing a SAVE AS under the 
FILE menu. DEPosition file names have the format 
Dnn.DEP where nn is the deposition number. 

If you are continuing your work from an earlier session, 
load the previously saved .DEP file using FILE/OPEN. 45 
Note: When you exit the LIPSYNC program, always store 
your work by doing a FILE/SAVE. You can also save your 
work from the Sync Video menu. 

2. If a new deposition is being started, you must first load the 
converted ASCII file. 

Click on the Transcript Information icon to enter the name 
of the DnnCNVT.TXT file you are going to sync to: 
Use the BROWSE button to locate the file name 
Set the starting page number and lines per page 5S 
Click on the "Scan File" button to scan in the file. 
If the Scan File says that the number of lines per page and 
pages doesn't match, go back to check the original DnnORI- 
G.ASC file, 

LIPSYNC now knows what DnnCNVT.TXT file to use and 60 
the number of lines per page and the starting page number. 
Click on DONE 

3. The next step is to tell LIPSYNC what video files are 
going to be used. The files, DnnSmmCM.AVI, etc. are on 
one or more CD-ROMS. If you are starting a new 65 
deposition, provide the names of the files that have 
already been written to CD-ROM. If you are continuing 
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from an earlier session, add file names to your existing list 

as new CD-ROMs become available. 
Click on the Video Files List icon from the main LIPSYNC 
menu. 

Enter the name of the deposition, normally the deponent's 
last name. 

Use the Add file button to add/create the list of video files. 
Note: Files are always added directly below the current 
highlighted file. If you are adding files to the bottom of the 
list, make sure you first highlight the bottom file name. 
Load the CD-ROM into your CD-ROM drive. In the first 
session, the correct CD-ROM will be CD-ROM num- 
ber one. In later or continuation sessions, the CD-ROM 
will be the next CD-ROM compressed. 
Highlight the bottom file name (if there is one) and Click 

on "Add File" 
Use the directory and drive letter buttons to locate the file 

on the CD-ROM drive (normally the D: drive). 
Highlight the desired file name and click on OK 
Enter CD-ROM number of this CD-ROM in the field 
provided 

Repeat the above procedure until you've added all the files 
for the CD-ROM. 

If you have additional CD-ROMs, insert the next CD-ROM 

into the CD-ROM drive and add the files for that CD-ROM. 

Be sure to enter the correct CD-ROM number. 

When you have completed adding all video files for all 

CD-ROMs, click on "OK" to put you back into the main 

menu. 

4. You are now back at the main menu. Save your work by 
clicking on FILE and select SAVE (this assumes you've 
already done a SAVE AS to establish your DEP file 
name). Save your work as a Dnn.DEP file where nn is the 
deposition number, 

5. You are now ready to begin synchronizing the voice to the 
video. 

Click on Sync Video. You will see a LIPSYNC Player 
window and a LIPSYNC Transcript window. 
The LIPSYNC Transcript window will display the first line 
of the transcript with the correct starting page number. For 
instance, 1:1 is for page one, line one. If page four is the 
starting page number, you should see 4:1. The first line of 
text is highlighted. 

In the beginning of the first session, there will be no file and 
frame numbers on the far left side. In a continuation from a 
prior session, you will see the file and frame numbers 
entered earlier. 

The LIPSYNC Player should be blank (all black) and the top 

of the window should say "All Files Closed". 

Open one file at a time, sync the voice to the text, and then 

go to the next file. The list of files was created in step 3. 

above. 

6. Procedure for each file. 

If you are continuing from a previous session, locate the 
point in the transcript where you left off. Clip on 
Transcript and the Find Next Frame Gap to move you 
to your last sync point. 

Open the list of video files by clicking on the yellow down 
arrow next to the "All File Closed" line. The list of files 
and their respective CD-ROM numbers will be shown. 
Select the next video file to process and make sure the 
correct CD-ROM is loaded. If this is the beginning, 
select file 1. 

Once you have selected the next video file to process, the 
first frame of that file will appear in the video window. 
Sometimes the frame is blank. 
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Start the video by pressing <Ctrl>P or by clicking on the 
"Player" button in the LIPSYNC Transcript window 
and then click on play. The video and sound will start. 

Note: CNTRL S will stop the video at any time $ 

You can now start synchronizing by pressing ENTER to 
move the transcript to the next line. 

NOTE: Most transcripts have a lot of text at the beginning 
that is not contained on the video. Press enter several 
times to move past such text and to find the first text 10 
that can be heard on the video. 

Normally someone will swear in the witness and the 
text/video starts right after that point. 

Also, as the deposition proceeds, there may be points 15 
where there is a lot of text that is not on the video (e.g., 
an off the record discussion). Again, press ENTER 
several time to advance the text. 

When you reach the end of the video segment it will stop 2 o 
(freeze) and the scroll bar will be all the way to the 
right. At this point you should go back to the main 
menu and Save your work in you Dnn.DEP file. Do a 
SAVE command and overwrite the previous Dnn.DEP 
file for this deposition. Update the LIPSYNC Process- 25 
ing Sheet. 

Go to the next video file, sync it, save and so forth until 
you have completed all video files. 

At the end of the transcript, there will be several pages 30 
that are not on the video. You must press enter several 
times (using the last file and frame number of the last 
file) to fill in with sync information. Go all the way to 
the bottom of the transcript. 35 
7. When you have processed all the files, the final step is to 

create the Sync file, normally a *.SYN file. The *.SYN 

file is the file that will be sent back to the client along with 

the *.TXT-file and the video CD-ROMS. 
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From the main menu, click on Make SYN File. 
The program will verify that you've done everything 
correctly and will tell you what to do if you have not. 
As each file is processed, its length will appear in a table 
on screen. Fill each length in on the Quality Control 
Check Off Sheet (FIG. 14). 
Save the *.SYN file in a project directory. From there you 
can copy it to a floppy disk along with the *.TXT file, 
e.g. the file area created for the project on the general 
purpose PC. When you save the SYN file, the SCD file 
is also saved. 
8.0 Quality Control 

Detailed instructions for filling out the Quality Control 
Check Off Sheet (FIG. 14) appear in section 2.3.5. Note that 
each sheet describes only one processed deposition. 
9.0 The Finished Product 

The diskette that accompanies the CD-ROMs contains 
three files. They are the converted text file and the SYN and 
SCD files that correspond to the video files. Note that for 
identification purposes, the file names on the diskette should 
be as close as possible to the name of the deponent 
(DEPONENT). For example, DEPONENT.TXT would be 
written for D02CNVT.TXT from the CLIENT.001 project. 
If the name is longer than eight characters, try to abbreviate 
it. Often the original ASCII file already has a name abbre- 
viation which the client firm uses for file identification. 

A diskette file called \LETTERS includes an inventory of 
materials. 

10.0 The VHS Tapes and Diskettes 

Each box of materials being returned to a client is 
accompanied by a return notification sheet which contains 
an inventory of the contents of the box. This file is also 
stored in \LETTERS. 



12/22/2003, EAST Version: 1.4.1 



31 



5,832,171 



32 



SECTION VI 
PART 1 . 

XCON 

Form text and graphical representation files FRM 



SB About XCON 




liansciipt Convc 


lei 


fttwi Veision 1.1k 




l.'apyiiyht [r.) 1 HNS hy Jurilo 


ch. Inc. 



about.bmp 



12/22/2003, EAST Version: 1.4.1 



5,832,171 



34 



ABOUT . FRM 



VERSION 2.00 
Begin Form About 

BackColor 

BorderStyle 

Caption = 

CiientHeight 

ClientLeft 

ClientTop 

ClientWidth 

ControlBox ~ 

Height 

Left 

LinkTopic 

MaxButton = 

MinButton 

ScaleHeight 

ScaleWidth 

Top 

Width 

Begin CommandButton 
Caption = 
Height 
Left 

Tab Index = 

Top 

Width 

End 

Begin Line Linel 

BorderColor = 

Index 

XI 

X2 

Yl 

Y2 

End 

Begin Line Linel 
BorderColor 
Index = 
XI 
X2 
Yl 
Y2 

End 

Begin Line Linel 
BorderColor 
Index 
XI 
X2 
Yl 
Y2 



&H0OFFOO0O& 

3 'Fixed Double 

"About XCON" 

1635 

3045 

3045 

3420 

0 'False 
2040 
2985 
"Forml" 



0 
0 

1635 

3420 

2700 

3540 

btnOk 
"Ok" 
345 
1305 
2 

1155 
795 



False 
False 



&H00FFFFFF& 

3 

0 

3400 
1620 
1620 



&H00FFFFFF& 

2 

0 

34 00 

0 

0 



&H00FFFFFF& 
1 

3400 
3400 
0 

1620 



12/22/2003, EAST Version: 1.4.1 



35 



5,832,171 



36 



ABOUT. FRM - 2 



End 

Begin Line Linel 

BorderColor = 
Index 
XI 
X2 
Yl 
Y2 

End 

Begin Label lblVersion 
Alignment = 
BackColor = 
Caption = 
ForeColor = 
Height 
Left 

Tablndex 
Top 
Width 
End 

Begin Label lblCopyright 



&H00FFFFFF& 
0 
0 
0 
0 

1620 



2 'Center 
fitHOOFFO000& 
"Version Lie" 
&H0000FFFF& 
270 
1200 
3 

405 
1620 



Alignment = 

BaclcColor 

Caption - 

ForeColor 

Height 

Left 

Tablndex 

Top 

Width 

End 

Begin Image iconVN 
Height 
Left 
Picture 
Top 
Width 

End 

Begin Label lblName 
Alignment 
BackColor = 
Caption 
ForeColor 
Height 
Left 

Tablndex 

Top 

Width 

End 



2 'Center 
&H00FFO000& 

"Copyright (c) 1995 by JuriTech, Inc 

&H00QQFFFF& 

285 

150 

1 

795 
3165 



480 

285 

(Icon) 

105 

480 



2 'Center 

&HOOFF00OO& 

"Transcript Converter" 

&HO000FFFF& 

300 

900 

0 

135 
2250 



End 



12/22/2003, EAST Version: 1.4.1 



37 



5,832,171 



38 



15 



Go to 



Tidnscript Line: j |; 



goto.bmp 



12/22/2003, EAST Version: 1.4.1 



5,832,171 



40 



GOTO.PRM - 1 

VERSION 2.00 

Begin Form GotoLine 



BorderStyle = 3 ' Fixed Double 

Caption = "Go to" 

ClientHeight = 1395 

ClientLeft = 3615 

ClientTop - 3210 

Clientwidth = 3015 

ControlBox = 0 'False 

Height * 1800 

Left = 3555 

LinkTopic - n Form2" 

MaxButton - 0 'False 

MinButton = 0 ' False 

ScaleHeight = 1395 

ScaleWidth = 3015 

Top - 2865 

Width = 3135 
Begin CommandButton btnCancel 

Cancel = -1 'True 

Caption = "Cancel" 

Height = 330 

Left = 1725 

Tab Index = 3 

Top = 8 55 

Width = 1215 

End 

Begin CommandButton btnOk 

Caption = "Ok" 

Default = -1 'True 

Height = 3 30 

Left = 120 

Tablndex » 2 

Top = 855 

Width « 1215 

End 

Begin TextBox txtLine 

Height = 300 

Left = 1620 

Tablndex = 1 

Top = 24 0 

Width = 1215 

End 

Begin Label IblLine 

Caption = "Transcript &Line ; " 

Height =» 255 

Left = 150 

Tablndex ■ 0 

Top = 285 

Width * 1425 



12/22/2003, EAST Version: 1.4.1 



5,832,171 

41 42 



GOTO . FRM - 2 
End 

End 
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Converting Transcript 



10OX 



progress . bmp 
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PROGRESS , FRM 



VERSION 2.00 

Begin Form Progress 
BacJcColor 
BorderStyle = 
Caption = 
ClientHeight 
ClientLeft 
ClientTop 
ClientWidth 
ControlBox = 
Height 
Left 

LinkTopic 

MaxButton a 

MinButton « 

ScaleHeight = 

ScaleWidth 

Top = 

Width 



&HO0C0C0OO& 

1 'Fixed Single 

"Converting Transcript" 

945 

2910 

2550 

4230 

0 'False 

1350 

2850 

" Form3 " 

0 'False 

0 "False 

945 

4230 

2205 

4350 



Begin PictureBox frmProgress 



Height 
Left 

ScaleHeight 

ScaleWidth 

Tablndex 

Top 

Width 



300 
450 
270 
3405 

1 

390 
3435 



Begin Label lblPercent 
Alignment 
BackStyle = 
Caption = 
Height 
Left 

Tablndex 

Top = 
Width 

End 

Begin Label lblTrack 
BackColor 
Height 
Left 

Tablndex = 
Top 
Width 
End 

End 

Begin Label Total 

Height = 270 

Left - 0 

Tablndex ~ 0 



2 'Center 
0 'Transparent 
"100*" 
240 
1110 
4 

45 
840 



&HO00OOOCO& 
495 
0 
3 
0 

1215 
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PROGRESS. FRM - 2 
Top 

Visible 
Width 

End 

Begin Label Current 
Height 
Left 

Tablndex 
Top 

Visible 
Width 

End 

End 



0 

0 'False 
1215 



270 
1380 
2 
0 

0 'False 
1215 
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Review Options 



'Conversion Range 
Staling Line: 

Ending Line: 

~ Line Number Area ' 
Eort Column: 

Latt Column: 

["Text 

Starting £olumn: 

Ending Column: 



'Time Code Area 
First Column: 

Last Column: 




revopt . bmp 
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REVOPT.FRM - 1 
VERSION 2 .00 

Begin Form ReviewOptions 

BorderStyle « 3 ' Fixed Double 

Caption - "Review Options" 

ClientHeight = 5070 

ClientLeft = 3030 

ClientTop = 1500 

ClientWidth = 3885 

ControlBox ~ 0 'False 

Height - 5475 

Left = 2970 

LinkTopic « "Forml" 

MaxButton = 0 'False 

MinButton = 0 'False 

ScaleHeight = 5070 

ScaleWidth = 3885 

Top = 1155 

Width = 4005 
Begin Frame frmTimeCode 

Caption = "Time Code Area" 

Height = 1110 

Left - 105 

Tab Index = 15 

Top = 3 3 90 

Width = 3530 

Begin TextBox txtTimeCodeCola 
Height - 315 

Left = 2010 

Tablndex - 17 

Top = 2 85 

Width - 1215 

End 

Begin TextBox txtTimeCodeColz 
Height = 315 

Left o 2010 

Tablndex = 19 

Top = 7 05 

Width = 1215 

End 

Begin Label lblTimeCodeCola 

Caption = "First Colu&mn:" 

Height » 240 

Left - 270 

Tablndex = 16 

Top = 345 

Width = 1650 

End 

Begin Label lblTimeCodeColz 

Caption a "Last Colum&n:" 

Height = 240 
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REVOPT , FRM - 2 

Left - 270 

Tablndex = 18 

Top = 750 

Width « 1650 

End 

End 

Begin Frame frmText 

Caption » "Text" 

Height = 1050 

Left = 90 

Tablndex = 10 

Top = 2310 

Width » 3630 
Begin TextBox txtTextColz 

Height » 315 

Left = 2010 

Tablndex = 14 

Top - 630 

Width - 1215 

End 

Begin TextBox txtTextCola 

Height = 315 

Left = 2010 

Tablndex = 12 

Top " 24 0 

Width = 1215 

End 

Begin Label lblTextColz 

Caption = "Endin&g Column:" 

Height = 240 

Left = 195 

Tablndex = 13 

Top = 660 

Width = 1395 

End 

Begin Label lblTextCola 

Caption = "Starting tColumn: 

Height = 240 

Left - 195 

Tablndex » 11 

Top = 270 

Width = 1515 

End 

End 

Begin Frame f rmLineNumberArea 

Caption = "Line Number Area" 

Height = 1110 

Left = 90 

Tablndex - 5 

Top = 1170 
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REVOPT . FRM - 3 

Width = 3630 

Begin TextBox txtLineNumColz 

Height = 315 

Left = 2010 

Tab Index » 9 

Top = 705 

Width = 1215 

End 

Begin TextBox txtLineNumCola 

Height = 315 

Left = 2010 

Tablndex = 7 

Top » 2 85 

Width = 1215 

End 

Begin Label lblLineNumColz 

Caption * "&Last Column:" 

Height = 240 

Left - 270 

Tablndex 8 

Top = 750 

Width = 1650 

End 

Begin Label lblLineNumCola 

Caption = "fcFirst Column:" 

Height - 240 

Left = 270 

Tablndex » 6 

Top = 345 

Width = 1650 

End 

End 

Begin Frame frmConvRange 

Caption = "Conversion Range" 

Height ■ 1125 

Left - 90 

Tablndex - 0 

Top = 15 

Width = 3615 

Begin TextBox txtEndLine 

Height = 315 

Left = 2010 

Tablndex = 4 

Top = 690 

Width » 1215 

End 

Begin TextBox txtStartLine 

Height = 315 

Left = 2010 

Tablndex = 2 
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REVOPT . FRM - 4 

Top = 270 

Width = 1215 

End 

Begin Label lblEndLine 

Caption *» "ScEnding Line:' 1 

Height = 240 

Left = 270 

Tablndex «* 3 

Top = 750 

Width - 1650 

End 

Begin Label lblStartLine 

Caption = "^Starting Line: 

Height = 240 

Left = 270 

Tablndex 4 = 1 

Top «* 330 

Width <* 1650 

End 

End 

Begin CoramandButton btnCancel 

Cancel = -1 'True 

Caption = "Cancel" 

Height * 330 

Left = 2160 

Tablndex = 21 

Top = 4665 

Width = 1215 

End 

Begin CommandButton btnOk 

Caption - "Ok" 

Default = -1 ' True 

Height = 330 

Left = 555 

Tablndex = 20 

Top « 466 5 

Width = 1215 

End 

End 
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xcon . bmp 
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XCON . FRM 



VERSION 2.00 
Begin Form Xcon 
Caption 
ClientHeight 
ClientLef t 
ClientTop 
ClientWidth 
Height 
Icon 
Left 

LinkTopic 

ScaleHeight 

ScaleWidth 

Top 

Width 



"Transcript Converter" 

2680 

1260 

2565 

6525 

3570 

(Icon) 

1200 

" Forml" 

2880 

6525 

1935 

6645 



&HO0C0COCO& 
"1/1" 

0 'False 
0 'False 
"MS Sans Serif" 
8 .25 



Begin PictureBox Toolbar 

BackColor - &H00C0C0C0& 

Height = 33 0 

Left = 2700 

ScaleHeight = 3 00 

ScaleWidth = 2460 

Tab Index = 1 

Top « 225 

Width « 2490 

Begin Label lblSel 
BackColor 
Caption 
FontBold 
Font Italic 
Font Name 
FontSize 
FontStrikethru = 0 'False 
FontUnderline - 0 'False 
Height = 225 

Left = 4 5 

Tablndex = 2 

Top = 30 

Width = 2220 

End 

End 

Begin CommonDialog Cdlg 

Left = 3015 

Top = 1185 

End 

Begin Editor Transcript 
BottomMargin ~ 0 
CaretHeight = -1 

CaretWidth = -1 

FileConvertOemAnsi* 0 'False 
FileOpen = 
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XCON.FRM - 2 

FileSaveAppend = 
FontBold 
Fontltalic 
FontName 

FontSize « 
FontStrikethru = 
FontUnderline 
Height 

InsertMode = 
Left 

Lef tMargin 

Password «* 

Readonly - 

RightMargin 

ScrollBars - 

SearchCaseSensitive= 

SearchOrigin 

SearchReplacement= 

SearchTarget 

SearchTo = 

Prop82 

SelBackColor 
SelDefaultType = 
SelDragDropEnable- 
SelForeColor 
TabDe fault Width - 
Tablndex 

Top = 
TopMargin 
UndoLimit = 
Width 

WrapAutomatically= 
WrapWholeWords » 
WrapX 

End 

Begin Label txtPreview 
BackColor 
BorderStyle 
Caption 
FontBold 
Fontltalic 
FontName 
FontSize 
FontStrikethru 
FontUnderline 
ForeColor 
Height 
Left 

Tablndex 
Top 



0 'False 
0 'False 
0 "False 
"Courier New" 
8.25 

0 'False 
0 'False 
1830 

- 1 ' True 

0 

0 

22886 

-1 'True 

0 

3 1 Both 

0 'False 

0 1 From Cursor 
ii ii 

ti ii 

1 'Bottom of text 

0 'False 
&H00000000& 

1 'Stream 
- 1 ' True 

&H0OFFFFFF& 

-1 

0 

0 

0 

255 
2400 

0 'False 
- 1 1 True 
-1 



&H00400000& 

1 'Fixed Single 

"Line not converted" 

0 'False 

0 "False 

" Courier New" 

8.25 

0 ' False 

0 'False 

&H00FFFFFF& 

240 

2700 

3 

555 
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XCON.FRM - 3 

Width - 3360 

End 

Begin Menu IDM_FILE 

Caption ~ « »&File" 
Begin Menu IDM_FILE_NEW 

Caption = " ScNew " 

End 

Begin Menu I DM_F I LE_OPENTRANS CR I PT 

Caption » "&0pen Transcript ... " 

End 

Begin Menu IDM_FILE_INSERT 

Caption = "tlnsert Transcript..." 

End 

Begin Menu IDM_FILE__SEP1 
Caption ~ 

End 

Begin Menu IDM_FILE_CONVERT 

Caption - "^Convert . . . " 

End 

Begin Menu I DM_FILE_SAVEAS 

Caption = "&Save As..." 

End 

Begin Menu IDM_FILE_SEP2 
Caption = "-" 

End 

Begin Menu IDM_FILE_ABOUT 

Caption = "A&bout..." 

End 

Begin Menu IDM_FILE_EXIT 

Caption - "E&xit" 

End 

End 

Begin Menu IDM_VIEW 

Caption = "feView" 

Begin Menu IDM_VIEW_GOTOLINE 

Caption = "&.Go to Document Line..." 

End 

Begin Menu IDM_VIEW_SEP2 
Caption 

End 

Begin Menu I DM_V I EW_RE ADONL Y 

Caption = "Transcript &Read-only" 

Checked = -l 'True 

End 

End 

Begin Menu IDM_FORMAT 

Capt ion = " Forma&t » 

Begin Menu IDM_FORMAT_NORMAL 

Caption «= "^Normal" 

Checked = -l 'True 



12/22/2003, EAST Version: 1.4.1 



67 



5,832,171 



XCON.FRM - 4 
End 

Begin Menu 
Caption 

End 

Begin Menu 
Caption 

End 

Begin Menu 
Caption 
Enabled 

End 

End 

Begin Menu IDM_OPTIONS 

Caption = "^Options" 

Begin Menu I DM_OPT I ONS_IGNORE PRETEXT 

Caption = "^Ignore Pre-Text Non-Line Area 

End 

End 

Begin Menu I DM_COMMAND 

Caption » "^Command" 

Begin Menu IDM_OPTIONS_STARTINGLINE 

Caption - "Set ^Starting Line" 

End 

Begin Menu I DM_OPT I ONS_ENDINGLINE 

Caption = "Set ^Ending Line" 

End 

Begin Menu IDM__0PTI0NS_SEP1 
Caption 

End 

Begin Menu IDM_OPTIONS_LINENUMBERAREA 

Caption = "Set &Line Number Area" 

End 

Begin Menu IDM_OPTIONS_TEXTCOLUMNA 

Caption = "Set Starting ScText Column" 

End 

Begin Menu IDM_OPTIONS_TEXTCOLUMNZ 

Caption = "Set Ending Te&xt Column" 

End 

Begin Menu I DM_0 P T I ONS_T I MECODEAREA 

Caption = "Set Time &Code Area" 

End 

Begin Menu IDM_0PTI0NS_SEP2 
Caption = "-" 

End 

Begin Menu IDM_OPTIONS_REVIEW 

Caption - " fcReview. , . " 

End 

End 

End 



I DM_FORMAT_UNDERS CORE 

"&Underscore/Hard CR" 

IDM_FORMAT_SEP 

o II _ It 

I DM_FORMAT_UND E RS CORE COLUMN 

"Set Underscore tColumn" 
0 'False 
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Files from XCON. ZIP (text converter) : 

# of files : Pages of Pages of 

Form Text: Source Code 



MISC 


BAS 


607 


11-09-95 


3: 


:43p 






1 


XCON 


BAS 


7,087 


01-30-96 


11: 


:23p 


2 




7 


ABOUT 


FRM 


1, 842 


01-30-96 


11 : 


:24p 




2 


1 


GOTO 


FRM 


1, 045 


11-13-9S 


1; 


:43p 




2 


1 


PROGRESS 


FRM 


1, 141 


11-10-95 


2 ; 


; 54p 




2 


1 


REVOPT 


FRM 


5, 7B5 


01-06-96 


2: 


:ilp 




4 


5 


XCON 


FRM 


11,683 


01-30-96 


11; 


:21p 


5 


4 


7 


XCON 


MAK 


249 


01-30-96 


11 


:24p 


1 






TEST 


TXT 


0 


01-06-96 


2 


:30p 


1 







11 filets) 29,439 bytes 
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PART 2. 
VIDLINK 

Form text and graphical representation files FRM 



VNTlme 



"Global Time 

Total Time: Q 
Cwrent Time: Q 
Last Frame: £ 

'Local Time 
jlttDeck* 

Fiame Time: [ 
Length: 



9 



Deck Stat Time: 



btDeckGtabalStart 



"Convert" 



|lrtConvef«om 




Result 



vntime .bmp 
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VNTIME . FRM - 1 



VERSION 2.00 



Bon i n Pnrm VMT i thp 






BorderStyle 


= 


1 'Fixed Single 


Caption 




"VN Time" 


ClientHeight 


a 


3810 


ClientLeft 




1095 


ClientTop 


a 


1485 


ClientWidth 




5565 


ControlBox 


a 


0 'False 


Height 




4215 


Icon 




(Icon) 


Left 


a 


1035 


LinkTopic 


a 


"Forml" 


MaxButton 




0 'False 


ScaleHeight. 




3810 


ScaleWidth 




5565 


Top 




1140 


Width 




5695 


Begin Frame frmConvert 


Caption 




= "Convert" 


Height 




2040 


Left 




2730 


Tablndex 




21 


Top 




1650 


Width 




2685 



Begin CommandButton btnConvert 



Caption 

Height 

Left 

Tablndex 

Top 

Width 



"Convert" 

345 

105 

0 

109S 
2460 



End 

Begin ComboBox IstConversions 



FontBold 
Fontltalic 
FontName 
FontSize 

FontStrikethru = 0 
Font Under line * 0 
Height * 300 

Left = 90 

Style = 2 

Tablndex = 15 



0 'False 
0 'False 
"MS Sans Serif" 
8.25 

False 
False 



Dropdown List 



Top 
Width 

End 

Begin Label lblFrom 
BorderStyle 



285 
2520 



'Fixed Single 
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VNTIME.FRM - 2 



FontBold = 
Fontltalic = 
Font Name = 
FontSize = 
FontStrikethru - 
FontUnderline 
Height 
Left 

Tablndex 

Top 

Width 

End 

Begin Label Label 10 
Caption 

Height * 
Left 

Tablndex - 

Top 

Width 

End 

Begin Label lblResult 
BorderStyle = 
FontBold = 
Fontltalic 
FontNarae = 
FontSize 
Font Strike thru 
FontUnderline = 
Height 
Left 

Tablndex = 
Top = 
Width 

End 

Begin Label Label8 
Caption 
Height 
Left 

Tablndex = 
Top 



Width 



0 'False 
0 'False 
"MS Sans Serif" 
S.25 

0 'False 

0 'False 

300 

750 

1 

690 
1800 



"From: 

330 

90 

17 

705 

630 



Fixed Single 
•False 
• False 
Sans Serif" 

False 
False 



1 
0 
0 

"MS 
8.25 
0 
0 
300 
765 
18 

1560 
1800 



"Result:" 

330 

105 

16 

1575 
630 



End 



End 

Begin Frame frmLocalTime 

Caption = "Local Time" 



Height 
Left 

Tablndex 

Top 

Width 



2025 

135 

11 

1665 
2505 
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_VNTIME . FRM - 3 

Begin ComboBox IstDecks 
Height - 300 

Left = 195 

Style = 2 'Dropdown List 

Tablndex « 12 



Top - 300 

Width = 2100 

End 

Begin Label IblDeckEnd 
BorderStyle 
FontBold 

Fontltalic = 
Font Name » 
FontSize 

FontStrikethru = 
FontUnderline 
Height 
Left 

Tablndex » 
Top 
Width 
End 

Begin Label Label7 

Caption = "Length: 1 

Height - 330 

Left = 105 

Tablndex = 19 

Top = 124 5 

Width = 720 

End 

Begin Label lblFrameTime 



1 'Fixed Single 
0 'False 
0 'False 
"MS Sans Serif" 
8.25 

0 'False 
0 'False 
525 
870 
20 

1200 
1530 



BorderStyle 

FontBold 

Fontltalic 

FontName 

FontSize 

FontStrikethru 

FontUnderline 

Height 

Left 

Tablndex 

Top 

Width 

End 

Begin Label Labels 
Caption 
Height 
Left 

Tablndex 



1 'Fixed Single 

0 'False 

0 'False 

" MS Sans Serif" 

8.25 

0 'False 

0 'False 

300 

1275 

14 

705 

1005 



"Frame Time: 

330 

150 

13 
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VNTIME.FRM - 4 



Top 
Width 



720 
1170 



End 



End 

Begin Frame f rmGlobalTime 

Caption = "Global Time" 



Height 
Left 

Tablndex 

Top 

Width 



1425 

90 

2 

105 
5370 



Begin ListBox IstDeckGlobalStart 



FontBold 
Fontltalic 
FontName 
FontSize 
FontStrikethru 
FontUnderline 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label Label4 
Caption 
Height 
Left 

Tablndex 
Top 
Width 
End 

Begin Label lblLastFrame 



0 'False 
0 'False 
"MS Sans Serif" 
8 .25 

1 False 
1 False 



0 
0 

810 
3180 
7 

540 
2085 



"Deck Start Time: ■ 
285 
3225 
10 
195 
1560 



BorderStyle 

FontBold 

Fontltalic 

FontName 

FontSize 

Font Strike thru 

FontUnderline 

Height 

Left 

Tablndex 

Top 

Width 

End 

Begin Label Labels 
Caption 
Height 
Left 



1 'Fixed Single 

0 'False 

0 'False 

"MS Sans Serif" 

8 .25 

0 ' False 

0 'False 

300 

1485 

9 

1050 
1515 



"Last Frame: 
285 



135 
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VNTIME. FRM - 5 



Tablndex 

Top 

Width 



8 

1050 
1185 



End 

Begin Label lb lCur rent Time 



BorderStyle 
FontBold 
Fontltalic 
Font Name 
FontSize 
FontStrikethru 
FontUnderline 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label Label2 
Caption 
Height 
Left 

Tablndex 
Top 
Width 
End 

Begin Label lblTotalTime 



Fixed Single 
0 "False 
0 'False 
"MS Sans Serif" 
8.25 

False 
False 



0 
0 

300 
1485 
6 

690 
1515 



" Current 
270 
120 
5 

735 
1305 



Time: " 



BorderStyle 

FontBold 

Fontltalic 

FontName 

FontSize 

FontStrikethru 

FontUnderline 

Height 

Left 

Tablndex 

Top 

Width 

End 

Begin Label Labell 
Caption 
Height 
Left 

Tablndex 

Top 

Width 

End 



1 'Fixed Single 
0 "False 
0 ' False 
"MS Sans Serif" 
8.25 

0 'False 

0 "False 

300 

1485 

4 

315 
1515 



"Total Time : 1 

255 

120 

3 

360 
1155 



End 



End 
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blackout .bmp 
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BLACKOUT. FRM - 1 

VERSION 2.00 

Begin Form Blackout 

BackColor 

BorderStyle 

Caption 

ClientHeight 

ClientLeft 

Client Top 

ClientWidth 

Height 

Left 

LinkTopic 

ScaleHeight 

ScaleWidth 

Top 

Width 

End 



&HO0OOOO0O& 

0 ' None 

"Blackout" 

1200 

1095 

1485 

2160 

1605 

1035 

" Forml" 

1200 

2160 

1140 

2280 
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Define a Video Segment 



fhi* screen n used to define one or mote, vidao 
legmertts foi playback in the ccuihoom. To define a 
segment, drag the cursor across the text of the 
segment To turn off this feature, unchecfc the 
"Auto-Define" option in the Segment menu. 



Segn*f*|la.ne: \ \ \ \ \ \ K,1Ra * uft 



defseg.bmp 
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DEFSEG. FRM - 1 
VERSION 2.00 

Begin Form Def ineSegment 



BorderStyle » 3 'Fixed Double 

Caption = "Define a Video Segment " 

ClientHeight = 2730 

ClientLeft * 2265 

ClientTop = 1995 

ClientWidth = 5085 

ControlBox = 0 'False 

Height - 3135 

Left = 2205 

LinkTopic = "Forml" 

MaxButton *= 0 ' False 

MinButton = 0 'False 

ScaleHeight =* 2730 

ScaleWidth = 5085 

Top = 1650 

Width = 5205 

Begin CommandButton btnPlay 

Caption = "&Play" 

Height = 390 

Left = 1950 

Tablndex = 3 

Top = 2220 

Width » 12X5 

End 

Begin CommandButton btnCancel 

Cancel = -1 'True 

Caption - "Cancel" 

Height - 3 90 

Left = 3540 

Tablndex = 4 

Top = 2220 

Width * 1215 

End 

Begin CommandButton btnDefine 

Caption = "&Define" 

Default = -1 'True 

Height = 390 

Left = 360 

Tablndex - 2 

Top = 2220 

Width = 1215 

End 

Begin TextBox txtSegmentName 

Height = 330 

Left - 105 

Tablndex » 1 

Top = 1710 

Width = 4860 
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DEFSEG . FRM 



End 

Begin Label lbllnfo 
BorderStyle 
Caption « 
Height 
Left 

Tab Index 

Top 

Width 

End 

Begin Label lblResult 
Caption 
Height 
Left 

TabTndex = 
Top 

Visible = 
Width 
End 

Begin Label 
Caption 
Height 
Left 

Tablndex 
Top 
Width 

End 



1 'Fixed Single 

"This screen is used to define one or more video segme 

1080 

120 

6 

105 
4845 



» lblResult" 
300 



3705 
5 

1275 
0 ' 
1215 



False 



lblSegmentName 

"Segment 
315 
105 
0 

1365 
1440 



&Name : " 



End 
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Video Directories 



- yjdeo File Segments: 



K CD ROM # Path 



lstSagnranto 



:CD fl.OM tt: I [ : : &ith: 



f ileopts .bmp 
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FILEOPTS . FRM - 1 

VERSION 2.00 

Begin Form FileOptions 

BorderStyle ■ 3 'Fixed Double 

Caption * "Video Directories" 

ClientHeight = 3525 

ClientLeft = 1335 

ClientTop = 1935 

ClientWidth - 7140 

ControlBox = 0 'False 

Height - 3930 

Left - 1275 

LinkTopic = "Forml" 

MaxButton - 0 ' False 

ScaleHeight = 3 525 

ScaleWidth - 7140 

Top s 1590 

Width = 7260 

Begin CommandButton btnCancel 

Cancel = -1 'True 

Caption - "Cancel" 

Height = 330 

Left = 3310 

Tab Index = 8 

Top = 3030 

Width = 1215 

End 

Begin CommandButton btnSave 

Caption s "&Save" 

Height = 330 

Left = 2235 

Tablndex « 7 

Top = 3030 

Width = 1215 

End 

Begin TextBox txtPath 

Height = 315 

Left = 2925 

Tablndex = 6 

Top = 244 5 

Width - 3915 

End 

Begin TextBox txtGroup 

Height = 315 

Left - 1320 

Tablndex = 4 

Top = 244 5 

Width = 555 

End 

Begin ListBox IstSegments 

FontBold = -1 'True 
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FILEOPTS . FRM - 2 



Fontltalic 

Font Name = 

FontSize » 

FontStrikethru = 

FontUnderline 

Height 

Left 

Tablndex 

Top = 
Width 

End 

Begin Label lblPath 
Caption 
Height 
Left 

Tablndex = 
Top » 
Width 

End 

Begin Label lblGroup 
Caption = 
Height 
Left 

Tablndex 

Top = 
Width 

End 

Begin Label lblSegList 
BorderStyle 
Caption = 
FontBold = 
Fontltalic 
FontName = 
FontSize 

FontStrikethru = 

FontUnderline 

Height 

Left 

Tablndex - 

Top 

Width 

End 

Begin Label lblSegment 
Caption 
Height 
Left 

Tablndex 
Top 
Width 

End 



0 'False 
"Courier New" 
9.75 

0 'False 

0 'False 

1470 

165 

2 

720 
6795 



»&Path:" 
255 
2190 
5 

2490 
600 



"CD &ROM # : ' 

255 

270 

3 

2490 
1065 



1 1 Fixed Single 
" # CD ROM # Path 
- 1 1 True 
0 'False 
"Courier New" 
9.75 

0 'False 

0 'False 

270 

165 

1 

465 
6795 

s 

"&Video File Segments 

225 

240 

0 

120 
2880 
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FILEOPTS . FRM - 3 
End 
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VidcoNotc Launcher jfllpfl 



launcher.bmp 
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LAUNCHER . FRM 



VERSION 2.00 

Begin Form Launcher 

Caption ■ 

ClientHeight 

ClientLeft 

ClientTop 

ClientWidth 

Height 

Left 

LinkTopic ~ 

ScaleHeight 

ScaleWidth 

Top 

Width 

. End 



"VideoNote Launcher" 

1560 

2715 

2910 

3210 

1965 

2655 

"Forml" 

1560 

3210 

2565 

3330 
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Transcript Text Position I BIDS! 



T«it corresponding to the current 
video display should appeal 
where in the tianicript window? 

"Teit position 

O £enterod 

O Line* from top: | | 



□ bOkay 



: ' line Offtet 



lineoff.bmp 
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LINEOFF.FRM - 1 
VERSION 2.00 

Begin Form LineOf f setDlg 



BorderStyle = 3 'Fixed Double 

Caption ■ "Transcript Text Position" 

ClientHeight - 2550 

ClientLeft = 2760 

ClientTop = 2760 

ClientWidth « 3300 

ControlBox = 0 'False 

Height = 2955 

Left = 2700 

LinkTopic = "Forml" 

MaxButton * 0 1 False 

MinButton = 0 'False 

ScaleHeight » 2550 

ScaleWidth « 3300 

Top = 2415 

Width = 3420 

Begin Frame Position 

Caption = "Text ^Position" 

Height = 1100 

Left = 270 

Tab Index = 1 

Top = 810 

Width = 2715 

Begin OptionButton btnPosition 

Caption = " fcLines from top:" 

Height = 270 

Index = 1 

Left = 210 

Tablndex = 3 

Top = 650 

Width = 1650 

End 

Begin OptionButton btnPosition 

Caption = " ScCentered" 

Height = 2 70 

Index = 0 

Left = 210 

Tablndex = 2 

Top = 330 

Width = 1185 

End 

Begin TextBox txtLineOf f set 

Height = 285 

Left - 1920 

Tablndex = 4 

Top * 645 

Width « 480 

End 
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LINEOFF.FRM - 2 

End 

Begin CheckBox bOkay 

Caption = "bOkay" 

Height = 270 

Left - 405 

Tablndex = 7 

TabStop = 0 'False 

Top = 2 36 5 

Visible = 0 'False 

Width = 1020 

End 

Begin CommandButton btnCancel 

Cancel = -1 'True 

Caption = "Cancel" 

Height = 315 

Left = 1815 

Tablndex = 6 

Top = 2100 

Width *= 1020 

End 

Begin CommandButton btnOK 

Caption = u OK u 

Default ~ -1 'True 

Height = 315 

Left = 510 

Tablndex = 5 

Top = 2100 

Width = 960 

End 

Begin Label lblLineOf f set 

Caption » "Line Offset" 

Height = 2 85 

Left = 1875 

Tablndex = 8 

Top = 2880 

Visible - 0 'False 

Width = 1200 

End 

Begin Label lbllnstructions 

Caption = "Text corresponding to the current video display shoul 

Height = 675 

Left = 270 

Tablndex - 0 

Top =120 

Width = 2865 

End 

End 
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Eg] VldLInk Rayer Mff 

; Loading CO ROM: 



|TWt could lake a few moment*...) 



JDonc 



loading . bmp 
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LOADING. FRM - 1 



VERSION 2.00 

Begin Form LoadingMsg 

Borders tyle 

Caption 

ClientHeight 

ClientLeft 

ClientTop - 

Clientwidth 

ControlBox = 

Height 

Left 

LinkTopic « 
MaxButton b 
MinButton = 
ScaleHeight 
ScaleWidth 
Top - 
Width 



1 'Fixed Single 

"VidLink Player" 

2085 

2580 

3720 

4215 

0 ' False 
2490 
2520 
"Form2" 



• False 
' False 



420 

615 

390 

2895 

0 

1230 
2925 



0 
0 

2085 
4215 
3375 
4335 

Begin PictureBox tTotal 
Height 
Left 

ScaleHeight = 
ScaleWidth 
Tablndex 

Top = 
Width 

Begin Shape tDone 
BackColor 
BackStyle 
BorderColor 
Borders tyle 
Height 
Left 
Top 
Width 

End 

End 

Begin Label lblDone 
BorderStyle = 
Caption 
Height 
Left 

Tablndex 

Top = 
Width 
End 

Begin Label lblPleaselnsert 

Caption = "Loading CD ROM:" 

Height = 315 

Left - 180 



&H0OFF000O& 
1 ' Opaque 
&H00FF00OO& 
0 ' Transparent 
405 
0 
0 

15 



l 'Fixed Single 

"Done" 

270 

1350 

1 

2325 
1545 
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LOADING . FRM 



Tab Index 

Top 

Width 



2 

150 
1680 



End 

Begin Label lblMediaLabel 



Alignment 
BorderStyle 
Height 
Left 

Tab Index 

Top 

Width 

End 

Begin Label Label4 
Caption 
Height 
Left 

Tab Index 

Top 

Width 

End 



2 ' Center 

1 'Fixed Single 

450 

150 

3 

460 
3915 



"(This could take a few moments.. 

270 

600 

4 

1800 
2985 



End 
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moreinfo.bmp 
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MORE INFO. FRM - 1 

VERSION 2.00 

Begin Form Morelnfo 



BackColor = tHOOCOCOCOit 

BorderStyle = 1 "Fixed Single 

Caption = "Order Information" 

ClientHeight = 3105 

ClientLeft = 750 

ClientTop = 1620 

ClientWidth = 4740 

Height = 3510 

Left = 690 

LinkTopic = "Forml" 

MaxButton = 0 1 False 

MinButton = 0 1 False 

ScaleHeight = 3105 

ScaleWidth = 4740 

Top * 1275 

Width = 4860 

Begin SSPanel lblJuriTech 

BackColor = &H00COC0CO& 

BevelWidth = 3 

Caption = "JuriTech" 

Font3D = 0 'None 

Height = 1200 

Left = 345 

Tablndex * 2 

Top = 1110 

Width » 3975 

End 

Begin SSCommand btnOk 

Caption « "Ok" 

Font3D = 0 'None 

Height = 360 

Left = 1800 

Picture = (none) 

Tablndex = 1 

Top = 2520 

Width - 1215 

End 

Begin SSPanel Panel3Dl 

BackColor = &H00C0C0C0& 

BevelWidth = 3 

Caption - "For information on converting your VHS tapes and ASCI 

Font 3D - 0 'None 

Height ~ 750 

Left = 345 

Tablndex = 0 

Top - 24 0 

Width = 3975 

End 
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MORE INFO. FRM - 2 
End 
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Load CD ROM 



Please imcit CD ROM labeled: 



; "into CD ROM playef on drive: ; |btPi[H ■ 



: : F rou P ] : : Dwjpen 



mounter.bmp 
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MOUNTER. FRM - 1 

VERSION 2.00 
Begin Form Mounter 

BorderStyle = 3 "Fixed Double 

Caption - "Load CD ROM" 

ClientHeight = 2220 

ClientLeft = 2505 

ClientTop = 3075 

ClientWidth = 4170 

ControlBox = 0 "False 

Height 2625 

Left = 2445 

LinJcTopic = "Forml" 

MaxButton = 0 'False 

MinButton = 0 'False 

ScaleHeight = 2220 

ScaleWidth = 4170 

Top = 273 0 

Width = 4290 

Begin ComboBox IstDrive 

Height = 300 

Left = 3060 

Style = 2 1 Dropdown List 

Tablndex - 7 

Top = 1185 

Width = 675 

End 

Begin CheckBox bOpen 

Caption = "bOpen" 

Height = 375 

Left = 1920 

Tablndex = 5 

Top = 2505 

Visible = 0 'False 

Width = 1215 

End 

Begin CommandButton btnCancel 

Cancel = -1 'True 

Caption = " Cance 1 " 

Height - 360 

Left = 2280 

Tablndex ■ 4 

Top = 1695 

Width = 1335 

End 

Begin CommandButton btnOpen 

Caption - "fcLoad" 

Default = -l 'True 

Height » 375 

Left » 615 
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MOUNTER. FRM - 2 



Tablndex 
Top 
Width 

End 

Begin Label lblGroup 
BorderStyle = 
Caption 
Height 
Left 

Tablndex = 
Top 

Visible = 
Width 

End 

Begin Label lblDrive 
Caption 
Height 
Left 

Tablndex = 
Top 
Width 

End 

Begin Label lblMediaLabel 
Alignment 
BorderStyle 
Height 
Left 

Tablndex 
Top 
Width 
End 

Begin Label lblPleaselnsert 



3 

1680 
1320 



1 'Fixed Single 
"Group" 
330 
330 
6 

2535 

0 'False 
1320 



CD ROM player on &drive : 



"into 
270 
360 
2 

1245 
2565 



2 'Center 
1 'Fixed Single 
450 
120 
1 

540 
3915 



Caption 

Height 

Left 

Tablndex 

Top 

Width 



"Please 
315 
150 
0 

120 
2790 



insert CD ROM labeled: 



End 



End 
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| Scroll Options HUB 




Set the size of (he slept for the scroti bar. 
Measurements nay be in seconds, or as a 
percentage of the total size of the video fib. 






"Small Step* (Cbck ScroD Arrow) 

| 1 O Seconds [DOh 00m OOt) 

' ' Ofiwcent (OOh 00m 00s) 


Xunent Video 1 
; Length: 

•|00h fJOm 00s |- • 


; 'Large Steps (Click Scroll Elevator Shaft)" 

j 1 O Second* (OOhQOaOOs) 

' ' Ofercenl (OOh 00m 00s) 






. JblLaifleaianga | . . ji BmLmsah j 


; JMSnwDChanue | . -n End Otav 



scrllopt .bmp 
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SCRLLOPT . FRM - 1 



VERSION 2.00 

Begin Form StepSizeDlg 



BorderStyLe = 3 'Fixed Double 

Caption = "Scroll Options" 
ClientHeight = 3165 

ClientLeft » 1950 

ClientTop = 2385 

ClientWidth = 5400 

ControlBox = 0 'False 

Height = 3570 

Left = 1890 

LinkTopic = "Form3" 

MaxButton = 0 'False 

MinButton = 0 'False 

ScaleHeight = 3165 

ScaleWidth = 5400 

Top = 204 0 

Width « 5520 
Begin ComrnandButton btnCancel 

Cancel = -1 'True 

Caption = "Cancel" 

Height = 300 

Left o 4095 

Tablndex « 16 

Top = 2670 

Width - 1095 

End 

Begin ComrnandButton btnOk 

Caption = "OK" 

Default = -1 'True 

Height = 300 

Left = 4095 

Tablndex * 15 

Top = 2190 

Width t = 1095 

End 

Begin CheckBox bEndOk 

Caption = "End Okay" 

Height = 345 

Left = 2085 

Tablndex = 17 

Top = 403 5 

Visible = 0 'False 

Width = 1140 

End 

Begin Frame SmallSteps 

Caption = "&Small Steps (Click Scroll Arrow) " 

Height = 1005 

Left = 150 

Tablndex = 3 
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SCRLLOPT.FRM - 2 

Top = JOO 

Width = 3700 
Begin OptionButton nSmallUnits 

Caption « "^Percent" 

Height - 255 

Index = 1 

Left = 915 

Tab Index » 7 

Top = 610 

Width = 1055 

End 

Begin OptionButton nSmallUnits 

Caption = "Se&conde" 

Height = 255 

Index » 0 

Left = 915 

Tablndex = 5 

Top = 310 

Width =» 1065 

End 

Begin TextBox SmallSize 

Height = 300 

Left = 195 

Tablndex = 4 

Top * 4 20 

Width = 4 95 

End 

Begin Label tSmallPercent 

Caption = " (OOh 00m 00s)" 

Height = 210 

Left = 2175 

Tablndex = 8 

Top = 650 

Width » 1275 

End 

Begin Label tSmallSeconds 

Caption » " (OOh 00m 00s) " 

Height = 210 

Left = 2175 

Tablndex = 6 

Top = 345 

Width = 1275 

End 

End 

Begin Frame LargeSteps 

Caption = "&Large Steps (Click Scroll Elevator Shaft) 

Height = 1005 

Left = 150 

Tablndex = 9 

Top = 2040 
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SCRLLOPT . FRM - 3 

Width a J700 
Begin TextBox LargeSize 

Height = 3 00 

Left = 195 

Tablndex » 10 

Top = 420 

Width = 495 

End 

Begin OptionButton nLargeUnits 

Caption « "Se&conds" 

Height = 225 

Index - 0 

Left = 915 

Tablndex = 11 

Top = 310 

Width = 1215 

End 

Begin OptionButton nLargeUnits 

Caption = "^Percent" 

Height = 240 

Index = 1 

Left = 915 

Tablndex = 13 

Top » 610 

Width = 1095 
End 

Begin Label tLargePercent 

Caption = " (OOh 00m 00s) " 

Height - 210 

Left = 2175 

Tablndex - 14 

Top = 640 

Width = 1275 

End 

Begin Label tLargeSeconds 

Caption = "(OOh 00m 00s)" 

Height = 2 55 

Left => 2175 

Tablndex = 12 

Top = 345 

Width = 124S 

End 

End 

Begin Label lbl Large Change 

BorderStyle = 1 'Fixed Single 

Caption = "lblLarge Change" 

Height = 300 

Left = 270 

Tablndex = 19 

Top « 3690 
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SCRLLOPT. FRM 



Width 



1530 



End 

Begin Label lblSmallChange 

BorderStyle = 1 'Fixed Single 



Caption = 
Height 
Left 

Tablndex 

Top = 
Width 

End 

Begin Label FileLength 
BorderStyle 
Caption 
Height 
Left 

Tablndex = 
Top 

Width 

End 

Begin Label tVideoFile 
BorderStyle 
Caption 
Height 
Left 

Tablndex = 
Top 
width 

End 

Begin Label 
Caption 
Height 
Left 

Tablndex 
Top 
Width 
End 

Begin Label lbllnstructions 



" lblSmallChange" 
300 
270 
16 

4020 
1530 



1 'Fixed Single 
"File Length" 
300 
2145 
20 

3780 
1095 



1 'Fixed Single 
■«00h 00m 00s " 
255 
4005 
2 

1575 
1245 



lblVideoLength 

"Current Video Length; 1 
480 
4005 
1 

1050 
1230 



Al ignment 


2 '< 


BorderStyle 


1 ' ] 


Caption 


"Set 


Height 


705 


Left 


555 


Tablndex 


0 


Top 


120 


Width 


4320 



Fixed Single 
the size of the steps for the scroll bar. 



Measure 



End 



End 
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Change Segment Order 



Anginal Or dan 



ftlttOiflSegrt '.fam Order 



UlOrg 



tstNew 



segorder.bmp 
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SEGORDER . FRM - 1 

VERSION 2.00 

Begin Form SegReorder 

BorderStyle = 3 'Fixed Double 

Caption = "Change Segment Order" 

ClientHeight = 3360 

ClientLeft = 1095 

ClientTop = 1485 

ClientWidth - 7365 

ControlBox = 0 'False 

Height - 3765 

Left = 1035 

LinkTopic = "Forml" 

MaxButton = 0 'False 

MinButton = 0 'False 

ScaleHeight - 3360 

ScaleWidth = 7365 

Top » 1140 

Width = 7485 

Begin ListBox IstNew 

Height = 2760 

Left o 4395 

Tablndex *» 9 

Top = 495 

Width = 2910 

End 

Begin ListBox IstOrgSegments 

Height = 225 

Left o 3225 

Tablndex • « 8 

Top = 75 

Visible = 0 'False 

Width = 960 

End 

Begin ListBox IstNewSegments 

Height = 225 

Left * 3180 

Tablndex - 7 

Top = 150 

Visible = 0 'False 

Width = 960 

End 

Begin CommandButton btnCancel 

Caption = "Cancel" 

Height = 450 

Left = 3060 

Tablndex - 6 

Top = 2790 

Width - 1215 

End 



Begin CommandButton btnDone 
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SEGORDER . FRM - 2 



Caption 

Height 

Left 

Tablndex 

Top 

Width 



" iDone ■ 
450 
3060 
5 

2250 
1215 



End 

Begin ComtnandButton btnReset 



Caption 

Height 

Left 

Tablndex 

Top 

Width 



"<<- fcReset" 

450 

3060 

4 

1365 
1215 



End 

Begin CommandButton btnMove 



Caption 
Default 
Height 
Left 

Tablndex 

Top = 
Width 

End 

Begin ListBox IstOrg 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label lblNew 
Caption 
Height 
Left 

Tablndex = 
Top 
Width 

End 

Begin Label lblOriginal 
Caption 
Height 
Left 

Tablndex 
Top 
Width 



"&Move -» tt 
-1 'True 
450 
3060 
2 

555 
1215 



2760 
105 
1 

495 
2910 



"&New Order: 
285 
4365 
3 

90 

1800 



"^Original Order: 

285 

135 

0 

105 
1800 



End 



End 
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; Rb Format jjuriTech SYNC Fiie 



; Product Name: VideoNote"" 
; Version: p.02d 



: fbc vemon: :::::: P I : 

; Lowest Readable Version: ; ft | ! 
; Highest Readable Version: ; fP~| : 



version.bmp 
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VERSION. FRM - 1 

VERSION 2,00 
Begin Form Version 

Caption = "Version Information" 

ClientHeight = 2430 

ClientLef t •= 1080 

ClientTop - 1470 

ClientWidth = 4545 

Height = 2835 

Left = 1020 

LinkTopic = "Form2" 

ScaleHeight = 2430 

ScaleWidth = 4545 

Top = 1125 

Width = 4665 

Begin Label nHiVersion 

BorderStyle = 1 1 Fixed Single 

Caption = "1" 

Height » 2 55 

Left = 2655 

Tablndex = 11 

Top = 1995 

Width = 405 

End 

Begin Label lblHighestVersion 

Caption = "Highest Readable Version:" 

Height = 240 

Left - 165 

Tablndex » 10 

Top = I960 

Width = 2280 

End 

Begin Label nLoVereion 

BorderStyle = 1 'Fixed Single 

Caption = "1" 

Height « 255 

Left = 2670 

Tablndex = 9 

Top = 1650 

Width « 405 

End 

Begin Label lblLowestVersion 

Caption = "Lowest Readable Version:" 

Height » 240 

Left = 195 

Tablndex » 8 

Top - 1635 

Width = 2280 

End 

Begin Label nFileVersion 

BorderStyle = 1 ' Fixed Single 
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VERSION. FRM - 2 



Caption = "1" 

Height = 255 

Left = 2655 

Tablndex » 7 

Top = 1245 

Width « 405 

End 

Begin Label 

Caption - 
Height 
Left 

Tablndex = 
Top 
Width 

End 

Begin Label sVersion 
BorderStyle ~ 
Caption 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label lblVersion 
Caption = 
Height 
Left 

Tablndex = 
Top 
Width 

End 

Begin Label sFileFormat 
BorderStyle 
Caption 
Height 
Left 

Tablndex 
Top 
Width 



lblFileVersion 

= "File Version: " 
240 
195 
6 

1275 
1650 



1 'Fixed Single 
"1.02d" 
255 
1905 
5 

855 
2340 



"Version : " 
240 
225 
4 

870 
1650 



1 'Fixed Single 
"JuriTech SYNC File" 
255 
1935 
3 

165 
2340 



End 

Begin Label lblFileFormat 
Caption 
Height 
Left 

Tablndex 
Top 
Width 
End 

Begin Label sProductName 



"File Format:" 
240 
210 
2 

180 
1650 
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VERSION. FRM - 3 

BorderStyle = x 'Fixed Single 

Caption = "VideoNote" 

Height = 255 

Left = 1905 

Tab Index «» 1 

Top = 4 95 

Width = 2340 

End 

Begin Label lblProductName 

Caption = "Product Name:" 

Height = 24 0 

Left - 210 

Tab Index = 0 

Top = 510 

Width = 1650 

End 

End 
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VldLink 



Rle tfcw £asc Iran script Search Segment 



Command 



• rT«antcrlpt Nana [ . 



: |Line» Pet Page 
" [Starting Page 



vidlink .bmp 
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VIDLINK. FRM 



VERSION 2.00 
Begin Form VidLink 

Caption 

ClientHeight 

ClientLeft 

Client Top 

ClientWidth 

Height 

Icon 

KeyPreview 
Left 

LinkTopic 

ScaleHeight 

ScaleWidth 

Top 

Width 



"VidLink" 

5025 

1005 

1560 

5925 

5715 

(Icon) 

- 1 • True 

945 

" Forml" 

5025 

5925 

930 

6045 



Begin ListBox lstSegments 



Height 
Left 

Tablndex 
Top 

Visible 
Width 



420 

2010 

13 

3495 
0 

1215 



False 



End 

Begin PictureBox z_frmToolbar 



BackColor 

Height 

Left 

ScaleHeight 

ScaleWidth 

Tablndex 

Top 

Width 



&H00C0C0C0& 

420 

105 

390 

4470 

10 

4170 
4500 



Begin ComboBox IstSegNames 



BackColor 

Font Bo Id = 

Fontltalic 

Font Name = 

FontSize 

FontStrikethru = 

FontUnderline 

Height 

Left 

Style 

Tablndex <* 



&HO0COC0C0& 
0 'False 
0 'False 
"Courier New" 
8.25 



0 
0 

315 

60 

2 

11 



' False 
•False 



Dropdown List 



Top 
Width 

End 

Begin Label lblSel 



45 

2250 
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BackColor 

BorderStyle 

FontBold 

Fontltalic 

FontName 

FontSize 

FontStrikethru 

FontUnderline 

Height 

Left 

Tablndex 

Top 

Width 



&H0OCOC0CO& 

1 'Fixed Single 

0 'False 

0 'False 

"Courier New" 

6.25 

0 'False 

0 'False 

300 

2025 

12 

45 

2370 



End 



End 

Begin Timer VideoUpdate 
Interval = 250 

Left = 210 

Top - 2205 

End 

Begin PictureBox IpFrame 
Height = 2055 

Left = 0 

ScaleHeight = 2025 

ScaleWidth = 690 

Tablndex - 6 

Top = 0 

Width « 720 

Begin Label LP 

Alignment 

Caption 

FontBold 

Fontltalic 

FontName 

FontSize 

FontStrikethru 

FontUnderline 

Height 

Left 

Tablndex 
Top 
Width 
End 

End 

Begin Editor Transcript 
BottomMargin = 0 
CaretHeight = -1 
CaretWidth = -1 

FileConvertOemAnsi= 0 'False 
FileOpen * 



1 'Right Justify 
"199:99" 
0 "False 
0 'False 
"Courier New" 
8.25 

0 'False 
0 'False 
4560 
0 
5 
0 

660 
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FileSaveAppend = 
FontBold 

Fontltalic - 

FontName 

FontSize 

FontStrikethru = 

FontUnderline « 

Height 

InsertMode 

Left 

LeftMargin 
Password = 
Readonly = 
RightMargin 
ScrollBars 
SearchCaseSenaitive* 
SearchOrigin = 
SearchReplacement= 
SearchTarget = 
SearchTo = 
Prop82 

SelBackColor = 

SelDef aultType 

S e 1 DragDropEnabl e = 

SelForeColor 

TabDefauXtWidth - 

Tab Index = 

Top 

TopMargin = 

UndoLimit 

Width 

WrapAutomatically= 
Wr apWho 1 eWords = 
WrapX 

End 

Begin Label TopLine 
Caption » 
Height 
Left 

Tablndex - 
Top 

Visible 
Width 

End 

Begin Label TopPage 
Caption = 
Height 
Left 

Tablndex 
Top 



0 1 False 
0 'False 
0 'False 
"Courier New" 
8.25 

0 'False 
0 'False 
1140 

-1 'True 

780 

0 

22886 

-1 'True 

0 

2 'Vertical 

0 'False 
0 ' From Cursor 



1 'Bottom of text 

0 'False 
&HO000000O& 

1 ' Stream 
- 1 ' True 

&H00FFFFFF& 

-1 

0 

60 
0 

255 
2940 

0 'False 
-1 'True 
-1 



" TopLine" 

255 

45 

9 

3735 

0 'False 
1215 



"TopPage" 

255 

30 

8 

3375 
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Visible = 0 'False 

Width = 1215 

End 

Begin Label Command 

Caption - " Command" 

Height = 285 

Left = 30 

Tablndex = 7 

Top = 2805 

Visible = 0 'False 

Width = 1215 

End 

Begin Label IblStartingPage 

BorderStyle = 1 'Fixed Single 

Caption = "Starting Page" 

Height = 255 

Left - 1770 

Tablndex = 4 

Top = 2280 

Visible - 0 'False 

Width = 1590 

End 

Begin Label lblLinesPerPage 

BorderStyle = 1 'Fixed Single 

Caption = "Lines Per Page" 

Height = 255 

Left = 1785 

Tablndex = 3 

Top « 1980 

Visible = 0 'False 

Width = 1710 

End 

Begin Label lblTranscriptName 

BorderStyle = 1 'Fixed Single 

Caption = "Transcript Name" 

Height = 255 

Left = 1800 

Tablndex - 2 

Top = 1635 

Visible » 0 'False 

Width = 1770 

End 

Begin Label lblFilename 

BorderStyle = l 'Fixed Single 

Caption - "Filename" 

Height = 255 

Left = 1830 

Tablndex » 1 

Top = 1320 

Visible = 0 'False 
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Width = 1215 

End 

Begin Menu ZM_FILE 

Caption - "&File" 

Begin Menu ZM_FILE_VIEWVIDE0 

Caption = "Activate &Video" 

Shortcut = "V 

End 

Begin Menu 2M_FILE_T00LS 

Caption = "&Tools" 

Enabled « 0 'False 

End 

Begin Menu ZM_FILE_SEP1 
Caption = "-" 

End 

Begin Menu ZM_FILE_EXIT 

Caption « "E&xif 

End 

End 

Begin Menu ZM_VIEW 

Caption = "tView" 

Begin Menu ZM_VIEWJTO0LBAR 

Caption = "^Toolbar" 

End 

Begin Menu ZM_VIEW_PAGELINE 

Caption = "&Page:Line Numbers" 

End 

Begin Menu ZM_VIEW_SEP1 
Caption = "-" 

End 

Begin Menu ZM_VIEW_TRANSCRIPT 

Caption - "Transcript &Only" 

End 

Begin Menu ZM_VIEW_ALL 

Caption « "Show &A11" 

End 

End 

Begin Menu ZM_CASE 

Caption = "&Case" 

Begin Menu ZM_CASE_NEW 

Caption = "&New" 

Enabled = 0 'False 

End 

Begin Menu ZM_CASE_OPEN 

Caption = "&Open..." 

Enabled = 0 ' False 

End 

Begin Menu ZM_CASEJDELETE 

Caption = "&Delete . . . " 

Enabled = 0 "False 
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VIDLINK. FRM - 6 
End 

End 

Begin Menu ZM_TRANSCR I PT 

Caption = " ^Transcript n 

Begin Menu ZM_TRANSCRIPT_IMPORT 
Caption = " fclmport . . . " 

Enabled » 0 1 False 

End 

Begin Menu ZM_TRANSCRIPT_EXPORT 

Caption = "&Export. . . " 

Enabled = 0 'False 

End 

Begin Menu ZM_TRANSCRIPT_ISSUES 

Caption - "I&ssues..." 

Enabled = 0 'False 

End 

Begin Menu ZM_TRANSCRIPT_SEP1 
Caption = "-" 

End 

Begin Menu ZM_TRANSCR I PT_UPDATE VI DEO 
Caption « "ScUpdate Video" 

End 

Begin Menu ZM_TRANSCRIPT_UPDATE 

Caption = "Update ScTranscript " 

End 

End 

Begin Menu ZM_FIND 

Caption - "Searc&h" 

Begin Menu ZM_F IND_F I ND 

Caption « "&Find Text. . . " 

Shortcut = A F 

End 

Begin Menu ZM_ F I ND_AG A I N 

Caption = "Find &Again" 

Shortcut - {F3 } 

End 

Begin Menu ZM_FIND_SEP1 
Caption = "-" 

Visible = 0 'False 

End 

Begin Menu ZM_FIND_SETUP 

Caption = "^Boolean Search Setup.. 

Enabled = 0 'False 

Visible = 0 'False 

End 

Begin Menu ZM_FIND_FULI>TEXT 

Caption = "Fu&ll Text Search" 

Enabled =• 0 'False 

Visible » 0 'False 

End 
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VIDLINK. FRM - 7 
End 

Begin Menu ZM_SEG 

Caption - "^Segment" 

Begin Menu ZM_S EG_AUTODEF I NE 

Caption = "&Auto-Def ine" 

Checked = - 1 ' True 

End 

Begin Menu ZM_SEG_SEP1 
Caption 

End 

Begin Menu ZM_SEG_DEFINE 

Caption = 11 &Define" 

End 

Begin Menu ZM_SEG_DELETE 

Caption = "De&lete" 

End 

Begin Menu ZM_SEG_ORDER 

Caption o "Change tOrder" 

End 

Begin Menu ZM_SEG_SEP2 
Caption = " 

End 

Begin Menu ZM_SEG_PLAY 

Caption = "&Play" 

End 

Begin Menu ZM_S EG_ PLAYS EQUENCE 

Caption = "Play ^Sequence" 

End 

End 

End 
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VIDPLAY . FRM 



VERSION 2.00 
Begin Form VidPlay 

BackColor 

BorderStyle 

Caption 

ClientHeight 

ClientLef t 

Client Top 

ClientWidth 

Height 

Icon 

Left 

LinkTopic 

MaxButton 

ScaleHeight 

ScaleWidth 

Top 

Width 



&HO0000O0O& 
1 'Fixed Single 
"VidLink Player" 
4095 
1065 
1755 
6480 
4785 
(Icon) 
1005 
"Forml" 
0 "False 
4095 
6480 
1125 
6600 



Begin PictureBox VidPanel 



BackColor 
BorderStyle 
Height 
Left 

ScaleHeight 

ScaleWidth 

Tablndex 

Top 

Width 



&HOO0OOOOO& 

0 'None 

690 

450 

690 

3600 

5 

3300 
3600 



Begin HScrollBar PlayPosition 
Height = 270 

Left = 0 

Tablndex = 8 

Top * 15 

Width = 2610 

End 

Begin MMControl Player 



AutoEnable 




0 ' 


False 


EjectEnabled 




-1 ' 


True 


Height 




405 




Index 




0 




Left 




0 




NextVisible 




0 


1 False 


PauseVi3ible 




0 


' False 


PlayEnabled 




-1 1 


' True 


RecordVisible 




0 


•False 


StopEnabled 




-1 


' True 


Tablndex 




7 




Top 




285 




Updatelnterval 




0 




Width 


S3 


3180 
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&H00FFFFFF& 
0 ' None 
340 
3175 
(Bitmap) 
345 
405 
6 

315 
410 



End 

Begin PictureBox btnSendToBack 
BackColor 
BorderStyle 
Height 
Left 
Picture 
ScaleHeight 
ScaleWidth 
Tab Index = 
Top 
Width 

End 

Begin Label PlayTime 
Alignment 
BorderStyle =» 
FontBold = 
Fontltalic 
Font Name = 
FontSize 

FontStrikethru = 
FontUnderline 
Height 
Left 

Tab Index « 
Top 
Width 

End 



1 Center 
'Fixed Single 
■ False 
' False 



"Arial" 
9.75 
0 
0 

270 
2610 
9 

15 
990 



False 
False 



End 

Begin PictureBox VidScreen 



BackColor 
BorderStyle 
Height 
Left 

ScaleHeight 

ScaleWidth 

Tablndex 

Top 

Width 



&H000000004 
0 ' None 
2985 
0 

2985 
6405 
0 

15 

6405 



Begin PictureBox MediaOffline 



BackColor 
BorderStyle 
Height 
Left 

ScaleHeight 
ScaleWidth 
Tablndex 
Top 

Visible 
Width 



&H00808080& 

0 ' None 

2700 

2715 

2700 

3600 

2 

165 
0 1 
3600 



False 
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Begin PictureBu.^ Of 
BackColor 
BorderStyle 
Height 
Left 

Picture > 
ScaleHeight 
ScaieWidth 
Tab Index 
Top 
Width 

End 

Begin CommandButton 
Caption 
Height 
Left 

Tablndex 
Top 
Width 
End 

End 

Begin MCIWND Video 
AutosizeMovie = 
Autos izeWindow = 
BorderStyle 
ErrorDig 

Filename * 

Height 

Index 

Left 

Menu - 
Playbar 

Record = 
Repeat 

Speed = 
TimeFormat » 
TimerFreq - 
Top = 
Visible 

Volume = 

WantPosEvent 

Width 

Zoom 

End 

Begin Label DeckCount 
Caption 
Height 
Left 

Tablndex 

Top = 



f lineMessage 
= &H00808080& 
= 0 1 None 
1005 
705 

o (Bitmap) 
1005 
2355 
4 

510 
2355 

btnLoad 

"Load CD ROM. 
345 
1020 
3 

1935 
1710 



0 'False 

-1 'True 

0 ' None 

0 'False 
it ti 

1185 
0 

105 

- 1 ' True 
0 'False 
0 'False 
0 'False 
1000 
it n 

500 
150 

0 'False 
1000 

0 'False 

2475 

100 



"DecJcCount" 

315 

825 

1 

1965 
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VIDPLAY . FRM - 4 

Visible - 0 'False 

Width o 1215 

End 

End 

Begin Timer VLTimer 

Left - 5565 

Top = 3180 

End 

Begin Menu IDM_FILE 

Caption = "&File" 

Begin Menu IDM_FILE_MOUNT 

Caption = "&Load CD ROM..." 

End 

Begin Menu IDM_FILE_EJECT 

Caption = "fcUnload CD ROM" 

End 

Begin Menu IDM_FILE_SEP1 
Caption = 

End 

Begin Menu I DM_F I LE_AB0UT 

Caption = "A&bout VidLink..." 

End 

Begin Menu I DM_F I LE_EX I T 

Caption = "E&xit" 

End 

End 

Begin Menu IDM_VIEW 

Caption = »&View" 

Begin Menu I DM_VI EW_REFRESH 

Caption = "^Refresh Video 11 

End 

Begin Menu I DM__V I E W_S E NDTOB AC K 

Caption = "&Send to Back" 

End 

Begin Menu IDM_VIEW_TRANSCRIPT 

Caption = "Activate ^Transcript" 

End 

Begin Menu IDM_VIEW_SEP1 
Caption = 

End 

Begin Menu IDM_VIEW_DOUBLESIZE 

Caption = "&Double Size" 

End 

Begin Menu IDM_VIEW_CLICKMOVE 

Caption = "fcClick-Move" 

End 

Begin Menu IDM_VIEW_BLACKOUT 

Caption = "&Blackout Background" 

End 

Begin Menu IDM_VIEW_ALWAYSONTOP 
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VIDPLAY . FRM - 5 

Caption = "^Always on Top" 

End 

End 

Begin Menu IDM_TRANSCRIPT 

Caption - "^Transcript " 

Begin Menu I DM_TRANS CR I PT_AUTOUPDATE 
Caption - "Auto-tUpdate" 

End 

Begin Menu IDM_TRANSCRIPT_SEP1 
Caption = "-" 

End 

Begin Menu I DM_TRANSCR I PT_UPDATE TRANSCRIPT 
Caption =» "Update &Transcript" 

End 

Begin Menu IDM_TRANSCRIPT_UPDATEVIDEO 
Caption = "Update fcVideo" 

End 

Begin Menu IDM_TRANSCRIPT_SEP2 
Caption « 

End 

Begin Menu IDM_TRANSCRIPT_TEXTPOSITION 

Caption = "Transcript Text ^Position . . . » 

End 

End 

Begin Menu IDM_PLAYER 

Caption = "fcPlayer" 

Begin Menu IDM_PLAYER_PLAY 

Caption * "tPlay" 

Shortcut = *p 

End 

Begin Menu I DM_PLAYER_STOP 

Caption = "&Stop" 

Shortcut = *S 

End 

Begin Menu IDM_PLAYER_SEP1 
Caption = "-" 

End 

Begin Menu IDM_PLAYER_GOTO 

Caption = "&Go to..." 

End 

Begin Menu IDM_PLAYER_SCROLLOPTIONS 

Caption = "Scroll ^Options . . . " 

End 

End 

Begin Menu IDM_DEBUG 

Caption = "&Debug" 

Visible • 0 'False 

End 

End 
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VLABOUT . FRM 



VERSION 2.00 
Begin Form VLAbout 

BorderStyle 

Caption 

ClientHeight 

ClientLeft 

ClientTop 

ClientWidth 

ControlBox 

Height 

Left 

LinkTopic 
MaxButton 
MinButton 
ScaleHeight 
Scalewidth 
Top 
Width 

Begin SSCommand btnOk 
Caption 
Font3D 
Height 
Left 

Picture = 
Tablndex 

Top = 
Width 
End 

Begin SSPanel pnlFrame 
BackColor 
BevelOuter - 
BevelWidth 
BorderWidth 
FloodColor 
Font 3D 
Height 
Left 

Tablndex 

Top 

Width 



3 'Fixed Double 
"About VidLink (TM) » 
2430 
2775 
2940 
3615 

0 'False 
2835 
2715 
" Forml " 
0 'False 
0 ' False 
2430 
3615 
2595 
3735 

"Ok" 

0 ' None 
360 
1200 
(none) 
7 

1950 
1215 



&HO0C0C0C0& 
1 'Inset 
0 
0 

&H00808000& 

0 ' None 

2565 

0 

0 

0 

3615 



Begin SSPanel pnlNotice 

BackColor - &H00808080& 

BevelOuter = 1 'Inset 

BevelWidth = 2 

Font 3D = 0 'None 

Height = 825 

Left = 105 

ShadowColor = 1 'Black 

Tablndex = 4 

Top = 990 
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Width ^= 3405 

Begin Label lblCopyright 



Alignment 

BackColor 

Caption 

FontBold 

Fontltalic 

FontName 

FontSize 

FontStrikethru 

FontUnderline 

ForeColor 

Height 

Left 

Tablndex 

Top 

Width 



2 'Center 
&H00808080& 

"Copyright (c) 1996 by JuriTech, 

0 'False 

0 'False 

"MS Sans Serif" 

8.25 

0 'False 

0 'False 

&H00O0OOO0& 

285 

135 

6 

120 
3150 



Inc. ' 



End 

Begin Label lblTrademark 



Alignment 
BackColor = 
Caption 
FontBold 

Fontltalic = 
FontName 

FontSize = 

FontStrikethru 

FontUnderline 

ForeColor = 

Height 

Left 

Tablndex 

Top 

Width 

End 

End 

Begin SSPanel pnlBanner 
BackColor = 
BevelOuter 
BevelWidth 
Font 3D 
Height 
Left 

ShadowColor 

Tablndex 

Top 

Width = 
Begin Label lblName 

Alignment 

BackColor 



2 'Center 
&H00808080fit 

"VidLink (TM) is a Trademark of JuriTech, Inc. 

0 'False 

0 'False 

"MS Sans Serif" 

8.25 

0 'False 

0 'False 

&H00O0Q0O0& 

315 

105 

5 

420 
3165 



&H00808080& 
1 * Inset 
2 

0 1 None 
750 



105 
1 
1 

105 
3405 



Black 



2 ' Center 
&H00808080& 
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Caption 
ForeColor 
Height 
Left 

Tablndex = 

Top 

Width 

End 

Begin Image iconVN 
BorderStyle 
Height 
Left 

Picture = 

Top 

Width 

End 

Begin Label lblVersion 
Alignment 
BackColor 
Caption = 
ForeColor 
Height 
Left 

Tablndex 

Top 

Width 

End 



End 



"VidLink (TM) 

&HO0O0FFFF& 

300 

750 

3 

105 
2535 



1 'Fixed Single 

510 

105 

(Icon) 

120 

510 



2 ' Center 

&H00808080& 

"Version" 

&H00OOFFFF& 

300 

750 

2 

375 
2535 



Video P^-yer" 



End 



End 
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Find Text 



;□ £a« Serwitivo 

:□ tfboic Woid*Gnis : : 

O Search backwards 

bok 



vlfind.bmp 
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VLFIND, FRM - 1 

VERSION 2.00 

Begin Form FindText 



BorderStyle = 3 'Fixed Double 

Caption - "Find Text" 

ClientHeight = 1770 

ClientLeft - 1995 

ClientTop = 2505 

ClientWidth = 4755 

ControlBox «= 0 'False 

Height = 2175 

Left - 1935 

LinkTopic - "Form2" 

MaxButton * 0 'False 

MinButton = 0 "False 

ScaleHeight = 1770 

ScaleWidth = 4755 

Top = 2160 

Width = 4875 

Begin CheckBox bOk 

Caption = "bOk" 

Height = 390 

Left = 1770 

Tablndex - 7 

Top = 1650 

Visible - 0 'False 

Width = 1215 

End 

Begin CommandButton btnCancel 

Cancel =* -1 'True 

Caption = "Cancel" 

Height = 330 

Left - 2985 

Tablndex = 6 

Top = 124 5 

Width = 1215 

End 

Begin CommandButton btnFind 

Caption = "&Find" 

Default » -1 'True 

Height = 330 

Left = 2985 

Tablndex = 5 

Top = 735 

Width = 1215 

End 

Begin CheckBox bBackwards 

Caption = "Search fcBackwards" 

Height = 330 

Left = 165 

Tablndex = 4 
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Top 
Width 



1365 
2025 



End 

Begin CheckBox bWholeWordsOnly 



Caption 

Height 

Left 

Tablndex 

Top 

Width 



"&Whole Words Only" 

330 

165 

3 

975 
1965 



End 

Begin CheckBox bCaseSensitive 



Caption 

Height 

Left 

Tablndex 

Top 

Width 

End 

Begin TextBox txtText 
Height 
Left 

Tablndex 

Top 
Width 

End 

Begin Label lblText 
Caption 
Height 
Left 

Tablndex 

Top = 
Width 

End 



"tCase Sensitive" 

330 

ISO 

2 

570 
1695 



300 
705 
1 

120 
3900 



"fcText:' 

270 

105 

0 

165 
525 



End 
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VN ALIVE . FRM - 1 

VERSION 2.00 
Begin Form VNAlive 

Caption 

ClientHeight 

ClientLeft 

ClientTop 

ClientWidth 

Height 

Left 

LinkTopic 

ScaleHeight 

ScaleWidth 

Top 

Width 

End 



"VideoNote Alive and Well" 

1620 

2235 

2895 

3540 

2025 

2175 

"Form2 " 

1620 

3540 

2550 

3660 
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'■ Minute*: * | | : 
; Second*: ; | ' " ' { ; 



O bOkay 



vngoto.bmp 
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VNGOTO.FRM - 1 



3 'Fixed Double 
"Seek to Time" 
1395 
3210 
2730 
3705 
0 

1800 
3150 
"Forma" 



* False 



0 
0 

1395 
3705 
2385 
3825 



1 False 
'False 



VERSION 2.00 
Begin Form VNGoTo 

BorderStyle 

Caption 

ClientHeight 

ClientLef t 

ClientTop 

ClientWidth 

Control Box 

Height 

Left 

LinkTopic 
MaxButton 
MinButton 
ScaleHeight 
ScaleWidth 
Top 
Width 

Begin CheckBox bOkay 
Caption = 
Height 
Left 

Tablndex 

Top = 
Visible = 
Width 
End 

Begin CommandButton btnCancel 



"bOkay 
495 
1485 
6 

1635 
0 

1215 



False 



Cancel 
Caption 
Height 
Left 

Tablndex 

Top 

Width 



-1 'True 

"Cancel" 

345 

2250 

7 

825 
1065 



End 

Begin CommandButton btnSeek 



Caption 
Default 
Height 
Left 

Tablndex 

Top 

Width 



"See&k" 

-1 'True 

345 

2235 

6 

240 
1065 



End 

Begin TextBox txtSeconds 
Height - 300 

Left = 1305 

Tablndex = 5 

Top = 990 
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Width = 510 

End 

Begin TextBox txtMinutes 



Height 
Left 

Tab Index 

Top 

Width 

End 

Begin TextBox txtHours 
Height 
Left 

Tablndex = 

Top 

Width 

End 

Begin Label ITime 
Caption * 
Height 
Left 

Tablndex 

Top 

Width 

End 

Begin Label Label3 
Caption 
Height 
Left 

Tablndex 

Top 

Width 

End 

Begin Label Label2 
Caption = 
Height 
Left 

Tablndex 

Top 

Width 

End 

Begin Label lblHours 
Caption = 
Height 
Left 

Tablndex 

Top 

Width 

End 

End 



300 

1305 

3 

555 
510 



300 

1305 

1 

120 
495 



" ITime " 
300 
180 
9 

1710 
1215 



" ScSeconda: 

270 

240 

4 

1020 
945 



■ ^Minutes : 1 

285 

240 

2 

600 
855 



"&Hours : 

300 

240 

0 

135 
645 
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VldNote Event Queues 




■MTr 


r 


App Event 


M 


Mattel Event 


D 


Deck Event 1 


p 
p 


App 


a 
* 

t 
e 
r 


Master 


e 
c 
k 


Deck 1 


App Slate | 


H 


«itai State 


Deck State 1 



vnq . bmp 
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VNQ.FRM - 1 



VERSION 2.00 
Begin Form VNQ 

BorderStyle 

Caption 

ClientHeight 

ClientLeft 

ClientTop 

ClientWidth 

ControlBox 

Height 

Icon 

Left 

LinkTopic 
MaxButton 
ScaleHeight 
ScaleWidth 
Top 
Width 

Begin ListBox Deck 
Height 
Left 

Tablndex = 
Top 
Width 

End 

Begin ListBox App 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin ListBox Master 
Height 
Left 

Tablndex = 
Top = 
Width 
End 

Begin Label lblAppActive 



1 'Fixed Single 
"VidNote Event Queues" 
2115 
960 
345 
7965 

0 'False 
2520 
t Icon) 
900 

" Form2 " 
0 'False 
2115 
7965 
0 

8085 

1590 
5460 
5 

270 
2505 



1590 
225 
1 

270 
2355 



1590 
2760 
0 

270 
2505 



BorderStyle 
Height 
Left 

Tablndex 
Top 
Width 
End 

Begin Label lblDeckState 

BorderStyle =* 1 'Fixed Single 

Caption « "Deck State" 



l 'Fixed Single 

255 

2220 

12 

1860 
345 
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VNQ.FRM - 2 

Height = 255 

Left = 5260 

Tab Index - 11 

Top = 1860 

Width - 2700 

End 

Begin Label lblMasterState 

BorderStyle » l 'Fixed Single 

Caption » "Master State" 

Height *= 2 55 

Left = 2580 

Tablndex = 10 

Top = I860 

Width » 2685 

End 

Begin Label lblAppState 

BorderStyle = 1 'Fixed Single 

Caption = "App State" 

Height = 2 55 

Left = 0 

Tablndex = 9 

Top = 1860 

Width = 2235 

End 

Begin Label lblDeckEvent 

BorderStyle - 1 'Fixed Single 

Caption = "Deck Event" 

Height - 270 

Left = 5460 

Tablndex = 8 

Top = 0 

Width = 2505 

End 

Begin Label lblMasterEvent 

BorderStyle - 1 'Fixed Single 

Caption = "Master Event" 

Height * 270 

Left = 2760 

Tablndex = 7 

Top = 0 

Width - 2505 

End 

Begin Label lblAppEvent 

BorderStyle = 1 'Fixed Single 

Caption = "App Event" 

Height = 270 

Left * 225 

Tablndex = 6 

Top = 0 

Width = 2355 
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VNQ.FRM - 3 
End 

Begin Label Label3 
BorderStyle 
Caption 
Height 
Left 

Tablndex 
Top 
Width 
Wordwrap 

End 

Begin Label Label2 
BorderStyle 
Caption 
Height 
Left 

Tablndex 
Top 
Width 
Wordwrap 

End 

Begin Label Labell 
BorderStyle 
Caption 
Height 
Left 

Tablndex 
Top 
Width 
Wordwrap 

End 

End 



1 'Fixed Single 

"D e c k" 

I860 

5260 

4 

0 

200 

- I 1 True 



1 'Fixed Single 

"Ma s t e r" 

1860 

2580 

3 

0 

180 

- 1 ' True 



1 'Fixed Single 

"A p p" 

1860 

0 

2 

0 

230 

- 1 1 True 
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PART 3. 
LIPSYNC 

Form text and graphical representation files FRM 



Checking Video Files.. 



# CD ROB Frames mSeca. filename 



riieLiat 



;■ indicates a problem with the vide o f3c 
;Cfick on a file for a description of lLl — 



Click an a file for a desertion of the problem. 




PiobletnLj : 



; □ Valid 



checkf il .bmp 
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216 



CHECKFIL . FRM - 1 

VERSION 2.00 

Begin Form CheckFiles 



BorderStyle - 3 'Fixed Double 

Caption = "Checking Video Files..." 

ClientHeight = 2310 

ClientLeft = 1275 

ClientTop = 1380 

ClientWidth - 7365 

ControlBox = 0 "False 

Height = 2715 

Left = 1215 

LinkTopic = "Forml" 

MaxButton =• 0 'False 

MinButton « 0 'False 

ScaleHeight = 2310 

ScaleWidth = 7365 

Top = 1035 

Width - 7485 

Begin CommandButton btnOk 

Caption - "Continue" 

Default = -l 'True 

Height = 315 

Left = 3075 

Tablndex = 3 

Top = 2550 

Width = 1275 

End 

Begin ListBox ProblemList 
Height = 615 

Left = 6090 

Tablndex = 8 

Top «• 343 5 

Visible « 0 'False 

Width - 870 

End 

Begin MMControl Player 

Height - 330 

Left = 5670 

Tablndex - 7 

Top = 4680 

Visible » 0 'False 

Width = 3540 

End 

Begin CheckBox bValid 

Caption = "Valid- 

Height * 255 

Left = 705 

Tablndex = 6 

TabStop «= 0 'False 

Top = 4695 
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CHECKFIL . FRM 



Visible 
Width 



0 'False 
1365 



End 

Begin CommandButton btnCancel 
Cancel 



Caption 
Height 
Left 

Tablndex 
Top 
Width 
End 

Begin ListBox FileList 
FontBold - 
Fontltalic 
FontName » 
FontSize = 
FontStrikethru => 
FontUnderline 
Height 
Left 

Tablndex = 
Top = 
Width 

End 

Begin Line LineS 
Borderwidth 
XI 
X2 
Yl 
Y2 

End 

Begin Line Line4 
XI 
X2 
Yl 
Y2 

End 

Begin Line Line3 
BorderWidth 
XI 
X2 
Yl 
Y2 

End 

Begin Line Line2 
BorderWidth 
XI 
X2 
Yl 



-1 'True 
"Return to Main Window" 
330 
4695 
5 

2430 
2520 



0 'False 
0 'False 
"Courier New" 
9 .75 

0 'False 

0 'False 

1950 

15 

1 

350 
7335 



2 
0 

7500 

340 

340 



0 

7500 

0 

0 



2 

7345 
7345 
0 

2280 



2 

15 
15 
0 
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CHECKFIL . FRM - 3 



Y2 = 2280 

End 

Begin Line Linel 
XI 
X2 
Yl 
Y2 

End 

Begin Label lblFootnote 
Caption 
Height 
Left 

Tab Index 

Top = 
Width 

End 

Begin Label txtProblem 
BorderStyle 
Caption 
Height 
Left 

Tablndex 

Top = 
Width 

End 

Begin Label lblHeader 
Caption 

FontBold = 
Fontltalic 
FontName 
FontSize 

FontStrikethru = 0 
FontUnderline « 0 
Height « 345 

Left = 60 

Tablndex = 0 

Top = 0 

Width = 7365 

End 



15 

8015 
2290 
2290 



indicates a problem with the video file. Click on 

450 
45 
4 

2355 
3960 



1 'Fixed Single 

"Click on a file for a description of the problem. 
540 
120 
2 

2850 
4185 



» # CD ROM 
0 'False 
0 'False 
"Courier New" 
9.75 

•False 
1 False 



Frames 



mSecs. 



Filename" 



End 
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f indtext .bmp 
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224 



FINDTEXT . FRM - 1 



VERSION 2.00 

Begin Form FindText 



BorderStyle = 3 1 Fixed Double 

Caption = "Find Transcript Text" 

ClientHeight = 1530 

ClientLeft = 2235 

ClientTop = 178 5 

ClientWidth = 5535 

ControlBox •= 0 'False 

Height = 1935 

Left - 2175 

LinkTopic « "Form2 n 

MaxButton = 0 'False 

MinButton = 0 'False 

ScaleHeight » 1530 

ScaleWidth = 5535 

Top = 1440 

Width = 5655 

Begin CommandButton btnDone 

Caption = "&Done n 

Height = 345 

Left = 3690 

Tablndex = 7 

Top » 1095 

Width = 174 0 

End 

Begin CommandButton btnStop 

Caption = "&Stop Search" 

Enabled = 0 'False 

Height - 345 

Left - 3690 

Tablndex * 6 

Top = 600 

Width = 174 0 

End 

Begin CommandButton btnBackward 

Caption - "Search &Backward w 

Height = 345 

Left = 1830 

Tablndex = 5 

Top - 600 

Width = 1740 

End 

Begin CommandButton btnForward 

Caption = "Search &Forward" 

Height » 345 

Left = 105 

Tablndex = 4 

Top - 600 

Width = 1605 
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FINDTEXT . FRM 



End 

Begin TextBox txtSearchText 

FontBold = 0 ' False 

Fontltalic - o 'False 

Font Name = "Arial" 

FontSize = 8.25 

FontStrikethru « 0 'False 

FontUnderline = 0 ' False 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label 

FontBold = 0 ' False 

Fontltalic = 0 'False 

FontName « "Arial" 

FontSize = 9.75 

FontStrikethru o 0 'False 

FontUnderline = 0 'False 

Height = 315 

Left - 2355 

Tablndex «= 3 

Top - 1110 

Width = 945 

End 

Begin Label lblSearching 



0 
0 

330 

1470 

1 

135 
3945 



IblSearchLine 
0 



FontBold 

Fontltalic 

FontName 

FontSize 

FontStrikethru 

FontUnderline 

Height 

Left 

Tablndex 

Top 

Width 

End 

Begin Label 
Caption 
Height 
Left 

Tablndex 
Top 
Width 

End 



'False 
'False 



"Arial" 
9.75 

0 'False 

0 'False 

300 

135 

2 

1110 
1965 



lblSearchText 

"Search tText : 
285 
135 
0 

180 
1230 



End 
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Set Line Range 



Set Range for ¥ideo File: 



Erom [PgrLn): : 



linerang.bmp 
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LINERANG . FRM 



VERSION 2.0 0 

Begin Form LineRange 

BorderStyle 

Caption = 

ClientHeight 

ClientLeft 

Client Top = 

ClientWidth 

ControlBox = 

Height » 

Left 

LinkTopic 

MaxButton 

MinButton 

ScaleHeight 

ScaleWidth 

Top 

Width 



3 'Fixed Double 

"Set Line Range" 

2505 

2910 

1875 

3345 

0 'False 

2910 

2850 

" Forml" 

0 'False 

0 'False 

2505 

3345 

1530 

3465 



Begin CommandButton btnCancel 



Cancel 
Caption 
Height 
Left 

Tablndex 

Top 

Width 



-1 'True 

"Cancel" 

300 

1770 

7 

1995 
1215 



End 

Begin CommandButton btnOk 

Caption - "Ok" 

Default = -1 ' 

Height - 300 

Left = 375 

Tablndex - 6 

Top = 1995 

Width = 1215 

End 

Begin TextBox txtTo 

Height = 33 0 

Left = 1635 

Tablndex = 5 

Top - 1425 

Width = 1215 

End 

Begin TextBox txtFrom 

Height = 330 

Left = 1635 

Tablndex = 3 

Top = 915 

Width = 1215 

End 



True 
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LINE RANG . FRM - 2 

Begin ComboBox lstViv~<>File3 
Height = 300 

Left = 120 

Style = 2 'Dropdown List 

Tablndex = 1 



Top = 465 

Width = 3030 

End 

Begin Label lblTo 
Alignment 
Caption > 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label lblFrom 
Alignment 
Caption 
Height 
Left 

Tablndex 
Top 
Width 
End 

Begin Label IblVideoFiles 

"Set 



1 'Right Justify 
"&TO (PgrLn) : " 
255 
180 
4 

1470 
1290 



1 'Right Justify 
"ficFrom (Pg:Ln) : " 
255 
180 
2 

960 
1290 



Caption 
Height 
Left 

Tablndex 

Top 

Width 



Range for fcVideo File: 



255 
180 
0 

135 
2265 



End 



End 
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file Action 



UpSync Editor 




lipsync.bmp 
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LIPSYNC.PRM - 1 



VERSION 2.00 
Begin Form LS 

BackColor = 

Borders tyle 

Caption 

ClientHeight 

ClientLeft 

ClientTop = 

ClientWidth 

Height 

Icon = 
Left 

LinkTopic = 

MaxButton ■ 

ScaleHeight « 

ScaleWidth 

Top = 

Width 

Begin PictureBox 
BackColor 
Height 
Left 
Picture 
ScaleHeight 
ScaleWidth 
Tablndex 
Top 
Width 

End 

Begin PictureBox 
BackColor 
Height 
Left 
Picture 
ScaleHeight 
ScaleWidth 
Tablndex 
Top 
Width 

End 

Begin PictureBox 
BackColor 
Height 
Left 
Picture 
ScaleHeight 
ScaleWidth 
Tablndex 
Top 
Width 



&H0080FF80& 
1 'Fixed Single 
"LipSync Editor" 
1920 
1350 
2760 
7020 
2610 
(Icon) 
1290 
"Forml" 
0 'False 
1920 
7020 
2130 
7140 
btnMakeSync 

&H00FFFF00& 

1725 

5235 

(Bitmap) 

1695 

1620 

3 

90 

1650 

btnVideoFilesList 
&H00FFFF00& 
1725 
1890 
= (Bitmap) 
1695 
1515 
2 

90 

1545 

btnSyncVideo 

&H0OFFFFO0& 
1725 
3570 
=» (Bitmap) 
1695 
1515 
1 

90 

1545 
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LIPSYNC. FRM - 2 
End 

Begin PictureBox btnTransInfo 

BackColor » &H00FFFF00& 

Height = 1725 

Left - 120 

Picture = (Bitmap) 

ScaleHeight = 1695 

ScaleWidth = 1620 

Tab Index = 0 

Top = 90 

Width = 1650 

End 

Begin Label lblFindText 
Height = 285 

Left = 1905 

Tablndex = 4 

Top = 4035 

Visible = 0 'False 

Width = 1665 

End 

Begin Menu IDM_FILE 

Caption = "&File" 

Begin Menu I DM_F I LE_NE W 

Caption - "&New n 

End 

Begin Menu I DM_F I LE_0 PEN 

Caption = "&Open. . . " 

End 

Begin Menu I DM_F I LE_S AVE 

Caption = "&Save" 

End 

Begin Menu IDM_FILE_SAVEAS 

Caption = "Save &As . . . " 

End 

Begin Menu IDM_FILE_SEP1 
Caption = "-" 

End 

Begin Menu I DM_F I LE_ IMPORT 

Caption = "fitlmport SYN File. 

End 

Begin Menu IDM_FILE_SEP2 
Caption = 

End 

Begin Menu I DM__F I LE_ABOUT 

Caption = "A&bout LipSync... 

End 

Begin Menu IDM_FILE_EXIT 

Caption - "E&xit" 

End 

End 
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LIPSYNC . FRM - 3 

Begin Menu IDM_EDIi 

Caption = "^Action" 

Begin Menu IDM_ACTION_TRAWSCRIPTINFO 

Caption = "&Transcript Info. . 

End 

Begin Menu IDM_ACTION_VIDEOFILES 

Caption = "&Video Files List. 

End 

Begin Menu IDM_ACTION_SYNCVIDEO 

Caption = "&Sync Video..." 

End 

Begin Menu IDM_ACTION_MAKESYNC 

Caption ~ = "&Make SYN File..." 

End 

End 

Begin Menu IDM_DEBUG 

Caption = "tDebug" 

Visible = 0 'False 

Begin Menu I DM_DEBUG_STATE 

Caption = "^Internal State" 

End 

End 

End 
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VideoNotu Li|»Sync Utility \\ 



Cupviiuhl (c) laa'J JutiTech. Inc. 



Is about .bmp 
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LSABOUT . FRM - 1 



VERSION 2.00 
Begin Form LipSyncAbout 

BackColor 

BorderStyle 

Caption 

ClientHeight 

ClientLeft 

ClientTop 

Clientwidth 

ControlBox 

Height 

Left 

LinkTopic 

MaxButton = 0 

MinButton » 0 

ScaleHeight « 1785 

ScaleWidth = 3525 

Top - 2415 

Width *> 3645 

Begin CommandButton btnOk 

Caption 

Height 

Left 

Tab Index 
Top 
Width 

End 

Begin Label lblVeraion 
Alignment = 
BackColor 
ForeColor 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label Label2 
BackColor 
Caption = 
ForeColor 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label Labell 
BackColor 
Caption - 



&H00000080& 
3 'Fixed Double 
"About LipSync" 
1785 
2475 
2760 
3525 

0 'False 
2190 
2415 
» Forml" 



False 
False 



"OK" 
330 
1245 
2 

1320 
1065 



2 • Center 
&H00000080& 
&H00FFFFFF& 
270 
1335 
3 

540 
1470 



&HO0000080& 

"Copyright (c) 1995 JuriTech, 
&HO0FFFFFF& 
270 
420 
1 

930 
3105 



&H00000080& 

"VideoNote LipSync Utility" 
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LSABOUT.FRM - 2 

ForeColor 

Height 

Left 

Tablndex 

Top 

Width 

End 

Begin Image Imagel 
Height 
Left 
Picture 
Top 
Width 

End 

End 



&H00FFFFFF& 

270 

1005 

0 

255 
2310 



480 

165 

(Icon) 

180 

480 
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fa UpSync Alive ■.'n'dWcll pi 



lsalive .bmp 
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LS ALIVE . FRM - 1 

VERSION 2.00 
Begin Form LSAlive 

Caption 

ClientHeight 

ClientLeft 

ClientTop 

ClientWidth 

Height 

Left 

LinkTopic 

ScaleHeight 

ScaleWidth 

Top 

Width 

End 



"LipSync Alive and Well" 

1620 

2805 

3270 

3540 

2025 

2745 

"Form2 " 

1620 

3540 

2925 

3660 
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lscd.bmp 
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LSCD.FRM - 1 

VERSION 2.00 

Begin Form LSCD 

Caption = "CDlg" 

ClientHeight = 1155 

ClientLeft = 1095 

ClientTop - 148 5 

ClientWidth = 1590 

Height = 1560 

Left = 1035 

LinkTopic = " Forml" 

ScaleHeight - 1155 

ScaleWidth = 1590 

Top « 1140 

Width = 1710 
Begin CommonDialog d 

Left = 420 

Top * 3 00 

End 

End 
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lsviewer.bmp 
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LSVIEWER . FRM - 1 

VERSION 2.00 

Begin Form LSViewer 

BorderStyle 

Caption 

ClientHeight 

ClientLeft 

ClientTop 

Clientwidth 

ControlBox 

FontBold 

Fontltalic 

FontName 

FontSize 

FontStrikethru = 

FontUnderline 

Height 

Icon 

KeyPreview 
Left 

LinkTopic 

MaxButton 

ScaleHeight = 

ScaleWidth 

Top 

Width 



1 'Fixed Single 

"LipSync Player" 

3255 

2835 

375 

3585 

0 'False 

0 'False 

0 'False 

"MS Sans Serif" 

8.25 

0 'False 

0 1 False 

3660 

(Icon) 

-1 'True 

2775 

"Forml" 



0 

3255 
3585 
30 

3705 



False 



Begin ComboBox VideoFiles 
Height = 300 

Left = 0 

Style = 2 'Dropdown List 

Tablndex = 4 



Top 
Width 



0 

3580 



End 

Begin HScrollBar PlayPosition 



Height 
Left 

Tablndex 

Top 

Width 



270 

0 

2 

3000 
2850 



End 



Begin PictureBox PlayWindow 



BackColor 

Height 

Left 

ScaleHeight 

ScaleWidth 

Tablndex 

Top 

Width 



&H0OO0O0OO& 

2720 

0 

2685 
3555 
1 

285 
3590 
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LS VIEWER . FRM - 2 



End 

Begin MMControl Player 
EjectVisible 
Height 
Left 

NextVisible 
RecordVisible 
Tab Index 

Top = 
Width 

End 

Begin Label SeekTo 
Caption 
Height 
Left 

Tablndex = 

Top 

Width 

End 

Begin Label Counter 
Alignment 
BorderStyle 
Caption 
FontBold 
Fontltalic 
FontName 
FontSize 

Fonts trikethru = 
FontUnderline 
Height = 
Left 

Tablndex 

Top = 
Width 

End 



False 



False 
False 



0 

450 

0 

0 

0 

0 

-500 
3450 



"Seek To" 
495 
-1500 
5 

1390 
1215 



1 'Right Justify 

1 'Fixed Single 

"000000" 

0 'False 

0 'False 

"Arial" 

9.75 

False 
False 



0 
0 
270 
2850 
3 

3000 
740 



End 
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OPENVIDE . FRM 



VERSION 2.00 

Begin Form OpenVideo 

BorderStyle = 

Caption 

ClientHeight 

ClientLeft 

ClientTop 

ClientWidth 

Control Box 

Height 

Left 

LinkTopic = 

MaxButton = 

MinButton => 

ScaleHeight 

ScaleWidth 

Top = 

Width 



3 'Fixed Double 

"Open Video File" 

2955 

2610 

2415 

4620 

0 'False 

3360 

2550 

"Form2 " 

0 'False 

0 "False 

2955 

4620 

2070 

4740 



Begin CommandButton btnCancel 



Cancel 
Caption 
Height 
Left 

Tablndex 

Top 

Width 



- 1 ' True 

" Cancel" 

315 

2580 

3 

2475 
1545 



End 

Begin CommandButton btnOpen 
Caption = "fcOpen" 

Default «= -1 'True 

Height = 315 

Left = 465 

Tablndex = 2 

Top = 2475 

Width = 1545 

End 

Begin ListBox VideoList 

Height = 1785 

Left = 135 

Tablndex = 1 

Top = 480 

Width - 4305 

End 

Begin Label IblVideoFileg 



Caption 

Height 

Left 

Tablndex 

Top 

Width 



-video tFiles: n 

270 

210 

0 

135 
1125 
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OPENVIDE . FRM - 2 
End 

End 
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EL 



Sync File 



file 



Basic Information" 
Transcript File: [~ 



Starting Page: | 
Number of [met: [ 
Deposition Narocrf 



Lines pet Pace: | | 
] . Number of Gioup* | | 



VideoFilesAfray~ 
Stoup/Na 



Number of Video File*: | | 



VideoGroupAndNa 



Length (Frames/Miffisecs): Transcript Line Range: 
VideoLength 



Video Line Range 



Frame Ust 



FienwUit 



Lme Positions: 



LnePositions 



syncfile.bmp 
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270 



SYNCFILE. FRM 



VERSION 2.00 

Begin Form SyncFile 

BorderStyle 

Caption 

ClientHeight 

Client Left 

ClientTop * 

ClientWidth 

ControlBox 

Height 

Left 

LinkTopic = 

MaxButton = 

ScaleHeight 

ScaleWidth 

Top 

Width 



1 'Fixed Single 

"Sync File" 

4755 

720 

1800 

6915 

0 'False 

5445 

660 

"Forml" 

0 'False 

4755 

6915 

1170 

7035 



Begin MMControl Player 

Height = 330 

Left = 5220 

Tablndex = 26 

Top = 4620 

Visible « 0 'False 

Width = 3540 

End 

Begin ListBox LinePositions 
Height = 1960 

Left «= 5265 

Tablndex = 0 

Top - 2670 

Width - 1515 

End 

Begin ListBox FrameList 

Height = 1590 

Left m 5295 

Tablndex = 1 

Top - 465 

Width = 1515 

End 

Begin Frame VideoFilesArray 



Caption 
Height 
Left 

Tablndex 
Top 
width 

Begin ListBox VideoLineRange 
Height = 810 

Left « 2700 

Tablndex = 21 



"VideoFilesArray" 
2550 
45 
15 

2130 
5085 
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SYNCFILE . FRM - 2 



Top = 1650 

Width = 2265 

End 

Begin ListBox VideoLength 

Height = 810 

Left = 135 

Tablndex = 19 

Top - 1665 

Width = 2265 

End 

Begin ListBox videoGroupAndName 

Height = 810 

Left = 120 

Tablndex = 18 

Top - 510 

Width = 4860 

End 

Begin Label lblVideoFiles 

Caption = "Number of Video Files:" 

Height = 285 

Left = 2055 

Tablndex = 7 

Top = 180 

Width = 1950 

End 

Begin Label txtVideoFiles 

BorderStyle = 1 'Fixed Single 

Height = 300 

Left = 4125 

Tablndex =» 10 

Top = 150 

Width = 450 

End 

Begin Label lblLineRange 

Caption = "Transcript Line Range:" 

Height = 210 

Left = 2745 

Tablndex - 22 

Top = 13 95 

Width = 2040 

End 

Begin Label lblVideoLength 

Caption » "Length (Frames/Millisecs) : " 

Height = 210 

Left = 150 

Tablndex = 2 0 

Top = 1395 

Width - 2355 

End 

Begin Label lb 1 VideoGroupAndName 
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SYNCFILE . FRM 



Caption 

Height 

Left 

Tablndex 

Top 

Width 

End 

End 

Begin Frame Basiclnfo 
Caption = 
Height 
Left 

Tablndex - 
Top 
Width 



"Group /Name : 11 

240 

120 

17 

285 

1380 



"Basic Information" 
1995 



60 
2 

75 

5070 

Begin Label lblNumGroups 

Caption = "Number of Groups:' 

Height = 285 

Left - 2445 

Tablndex = 16 

Top « 1200 

Width m 1605 

End 

Begin Label txtNumGroups 
BorderStyle 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label txtNumLines 



1 'Fixed Single 

300 

4155 

23 

1140 
585 



BorderStyle 

Height 

Left 

Tablndex 

Top 

Width 



1 

300 

1665 

14 

1155 
585 



Fixed Single 



End 

Begin Label lblTotalLines 
Caption 
Height 



Left 

Tablndex 

Top 

Width 



"Number of lines:" 
285 
165 
13 

1170 
1455 



End 

Begin Label txtDeposition 

BorderStyle = 1 'Fixed Single 

Height - 285 
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SYNCFILE . FRM 



Left 

Tab Index 
Top 
Width 

End 

Begin Label 
Caption 
Height 
Left 

Tab Index 
Top 
Width 
End 

Begin Label txtLinesPerPage 



1665 
12 

1530 
3285 

IblDeposition 

» "Deposition Name:" 
270 
105 
11 

1560 
1515 



1 

300 

3690 

9 

750 
585 



Fixed Single 



BorderStyle 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label 
Caption 
Height 
Left 

Tablndex 
Top 
Width 
End 

Begin Label txtStartingPage 

a 1 'Fixed Single 



lblLinesPerPage 

"Lines per Page: 
285 
2250 
8 

780 
1350 



BorderStyle 
Height 
Left 

Tablndex 
Top 
width 

End 

Begin Label 
Caption 
Height 
Left 

Tablndex 
Top 
Width 
End 

Begin Label txtTransFile 

BorderStyle = 1 'Fixed Single 

Height = 285 

Left = 1590 

Tablndex = 4 



300 
1470 
6 

750 
585 

lblStartingPage 

"Starting Page:" 
265 
180 
5 

780 
1290 
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SYNCFILE . FRM - 5 

Top « 330 

Width * 32B5 

End 

Begin Label lblTransFile 

Caption = "Transcript File:" 

Height = 270 

Left = 120 

Tablndex = 3 

Top - 3 30 

Width = 1395 

End 

End 

Begin Label Labell 

Caption = "Line Positions:" 

Height = 270 

Left = 5250 

Tablndex = 24 

Top = 2295 

Width * 1620 

End 

Begin Label lblFrameLiet 

Caption = "Frame List:" 

Height - 270 

Left = 5265 

Tablndex = 2 5 

Top = 165 

Width * 1620 

End 

Begin Menu TDM_FILE 

Caption - "&File" 

Begin Menu IDM_FILE__GETDATA 

Caption = "&Get Data" 

End 

Begin Menu IDM_FILE_SEP3 
Caption = " - " 

End 

Begin Menu IDM_FILE_READTVI 

Caption = "Read &TVI" 

End 

Begin Menu IDM_FILE_UPDATEDEPO 

Caption = " fcUpdate Deposition" 

End 

Begin Menu IDM_FILE_SEP1 
Caption = 

End 

Begin Menu I DM_F I LE_EX I T 

Caption * "E&xit" 

End 

End 

End 
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Transcript Information 



FBe Information ~ 
Olenaroe: 



Lines per Page: | | Starting Eaae Number: \ m _ | 



'Line Information - 
T otnl Lines: 



transinf.bmp 
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282 



TRANSINF . FRM - 1 
VERSION 2.00 

Begin Form Transcriptlnf o 

BorderStyle = 3 'Fixed Double 

Caption = "Transcript Information" 

ClientHeight = 31B0 

ClientLeft « 1110 

ClientTop = 1635 

ClientWidth = 5400 

ControlBox = 0 'False 

Height = 3585 

Left = 1050 

LinkTopic = "Form2 n 

MaxButton = 0 1 False 

MinButton = 0 * False 

ScaleHeight = 3180 

ScaleWidth = 5400 

Top - 1290 

Width «= 5520 

Begin Frame Filelnfo 

Caption = "File Information" 

Height = 1575 

Left « 120 

Tablndex = 0 

Top » 105 

Width = 5175 

Begin TextBox txtFilename 

Height = 285 

Left = 120 

Tablndex » 3 

Top = 6 90 

Width - 4860 

End 

Begin CommandButton btnBrowse 

Caption = "tBrowse. . . " 

Height = 350 

Left « 3840 

Tablndex » 2 

Top = 240 

Width = 1110 

End 

Begin TextBox txtStartingPage 

Height = 285 

Left - 4380 

Tablndex = 7 

Top = 1095 

Width * 525 

End 

Begin TextBox txtLinesPerPage 

Height = 285 

Left = 1610 
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284 



TRANS INF . FRM - 2 

Tablndex = 5 

Top = 1095 

Width = 525 

End 

Begin Label lblStartingPage 

Caption = "Starting &Page Number: 

Height = 195 

Left = 2325 

Tablndex = 6 

Top = 1155 

Width = 1995 

End 

Begin Label lblLinesPerPage 

Caption = "&Lines per Page:" 

Height * 255 

Left = 165 

Tablndex « 4 

Top = 1140 

Width = 1410 

End 

Begin Label lblFilename 

Caption = " ^Filename : " 

Height = 225 

Left - 180 

Tablndex = 1 

Top = 3 60 

Width = 960 

End 

End 

Begin Frame Linelnfo 

Caption - "Line Information" 

Height = 6 90 

Left - 105 

Tablndex = 8 

Top = 1815 

Width - 5190 

Begin CommandButton btnScan 

Caption = "&Scan File" 

Height = 350 

Left = 3795 

Tablndex = 11 

Top = 255 

Width « 1215 

End 

Begin Label txtNumLines 

Height = 255 

Left = 1260 

Tablndex - 10 

Top = 345 

Width = 2415 
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TRANS INF . FRM - 3 



End 

Begin Label lblNumLines 

Caption = "Total Lines: 

Height = 255 

Left = 150 

Tablndex - 9 

Top = 34 5 

Width » 1140 

End 

End 

Begin ComraonDialog Cdlg 

Left = 1680 

Top - 4 905 

End 

Begin ComraandButton btnCancel 



Cancel 
Caption 
Height 
Left 

Tablndex 

Top 

Width 



- 1 1 True 

"Cancel" 

350 

3015 

13 

2685 
1275 



End 

Begin CommandButton btnOk. 



Caption 
Default 
Height 
Left 

Tablndex 

Top 

Width 



"OK" 

-1 

350 

1185 

12 

2700 
1215 



True 



End 



End 
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Elle View Sync Iranscrlpt Bayer 



LlpSync Transcript 



Li AM I 



Ibis i» fc» saapW c«xc jure co sac how audi of this 
Jill fit in thm window 



' Command 



trnscrpt .btnp 
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290 



TRNSCRPT, FRM - 1 



VERSION 2.00 
Begin Form Transcript 

Caption = 

ClientHeight = 

ClientLeft 

ClientTop 

Clientwidth 

ControlBox » 

Height 

Icon - 
KeyPreview 
Left 

LinkTopic 
ScaleHeight 
ScaleWidth 
Top 
Width 

Begin Timer LinkTimer 
Left <= 
Top 

End 

Begin TextBox txtFrame 
FontBold = 
Fontltalic 
FontName 

FontSize = 
FontStrikethru « 
FontUnderline = 
Height 
Left 

MultiLine 
Tab Index 
Tabs top 

Text «» 
Top - 
Width 

End 

Begin TextBox txtLine 
FontBold 
Fontltalic 
FontName 

FontSize = 
FontStrikethru = 
FontUnderline - 
Height 
Left 

MultiLine « 
Tablndex = 
TabStop 
Text 



"LipSync Transcript" 
2595 
45 

4530 
9495 

0 'False 
3285 
(Icon) 
- 1 ' True 
-15 

" Form2 11 
2595 
9495 
3900 
9615 

7B45 
135 



0 'False 
0 'False 
"Courier New" 
8.25 

0 'False 
0 "False 
3775 
0 

-1 'True 
3 

0 'False 
"00 : 000000" 
240 



1075 



0 'False 
0 'False 
"Courier New" 
8.25 

0 'False 
0 'False 
3775 
925 

- l ' True 
0 

0 'False 
"000:00" 
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TRNSCRPT.FRM - 2 



Top 
Width 



240 
750 



End 

Begin VScrollBar TransPos 



Height 
Left 

Tab Index = 

Top 

Width 

End 

Begin TextBox txtText 
FontBold 
Fontltalic 
FontName « 
FontSize 

FontStrikethru = 
FontUnderline = 
Height 

HideSelection 
Left 

MultiLine 

Tab Index = 

TabStop 

Text 

Top 

Width 

End 

Begin Label txt Command 
Caption 
Height 
Left 

Tablndex » 
Top 

Visible = 
Width 

End 

Begin Label lblText 
Alignment 
BorderStyle 
Caption = 
FontBold 
Fontltalic 
FontName = 
FontSize « 
FontStrikethru = 
FontUnderline 
Height 
Left 

Tablndex o 
Top 



4020 
7365 
6 
0 

240 



'False 
1 False 

New" 



" Courier 
8.25 

0 'False 
0 'False 
3775 

0 'False 
1600 

- 1 ' True 
5 

0 'False 

"This is some sample text just to see how much of this 

240 

5755 



" Command " 
240 



7995 
8 

1050 
0 

1215 



False 



2 'Center 

1 'Fixed Single 

"Text " 

-1 'True 

0 'False 

"Courier New" 

8.25 

0 'False 

0 'False 

240 

1600 

4 

0 
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TRNSCRPT.FRM - 3 



Width 

End 

Begin Label lblFrarae 
Alignment = 
BorderStyle 
Caption 

FontBold = 
Fontltalic « 
FontName 

FontSize = 
FontStr ike thru 
FontUnderline = 
Height 
Left 

Tablndex 

Top 

Width 

End 

Begin Label IblLine 
Alignment 
BorderStyle 
Caption = 
FontBold 

Fontltalic = 

FontName 

FontSize 

FontStrikethru => 
FontUnderline = 
Height 
Left 

Tablndex = 

Top 

Width 

End 

Begin Label nCurLine 
Height 
Left 

Tablndex 

Top « 

Visible 

Width 

End 

Begin Menu IDM_ FILE 
Caption = 
Begin Menu IDM_FILE_ 
Caption 

End 

Begin Menu IDM_FILE_ 
Caption » 

End 



5755 



2 'Center 

1 'Fixed Single 

" Frame " 

-1 'True 

0 'False 

"Courier New" 

8.25 

0 'False 

0 'False 

240 

0 

2 

0 

925 



2 ' Center 

1 'Fixed Single 

"Line" 

-1 'True 

0 'False 

"Courier New" 

8.25 

0 'False 

0 'False 

240 

925 

1 

0 

675 



405 
0 
7 
0 

0 'False 
1035 



"&File" 
VALIDATE 

"&Validate" 

SEP1 

ri _ II 



12/22/2003, EAST Version: 1.4.1 



295 



5,832,171 



TRNSCRPT.FRM - 4 pat 

Begin Menu IDM_I J_SAVE 

Caption = "tSave" 

End 

Begin Menu IDM_FILE_SAVEAS 

Caption = "Save fcAs . . . " 

End 

Begin Menu IDM_FIL»E_SEP2 
Caption = 

End 

Begin Menu IDM_FIIjE_DONE 

Caption - "^Return to Main Window" 

End 

End 

Begin Menu IDM_VIEW 

Caption = "&View n 

Begin Menu IDM_VIEW_ALL 

Caption = "fiAll" 

End 

Begin Menu IDM_VIEW_TBXTONLY 

Caption =» "&Text Only" 

End 

Begin Menu IDM_SEP1 

Caption » "-" 

End 

Begin Menu IDM_VIEW_LINE 

Cap t ion = " Trans c r ip t &Li ne " 

End 

Begin Menu IDM_VIEW_FRAME 

Caption - "&Video Frame" 

End 

End 

Begin Menu IDM_SYNC 

Caption = "&Sync" 

Begin Menu IDM_SYNC_SYNC 

Caption - "&Sync Current Line (Enter)" 

End 

Begin Menu IDM_SYNC_UNSYNC 

Caption « "iUnsync (Backspace) 11 

End 

Begin Menu IDM_SYNC_SEP1 
Caption « "-" 

End 

Begin Menu I DM_S YNC_SETL I NERANGE 

Caption = "Set Line &Range..." 

End 

Begin Menu IDM_SYNC_SEP2 
Caption = " - " 

End 

Begin Menu IDM_SYNC_LINK 

Caption = "Simulate &Link" 
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TRNSCRPT . FRM - 5 
End 

End 

Begin Menu IDM_TRANS 

Caption - "^Transcript" 

Begin Menu IDM_TRANS_GOTOLINE 

Caption - "Go to &Line..." 

End 

Begin Menu I DM_TRANS_MATCHV I DEO 

Caption « "tMatch Transcript to Video Frame 11 

End 

Begin Menu IDM_TRANS_SEP1 
Caption 

End 

Begin Menu I DM_TRANS_F I ND 

Caption = " &Find Text ..." 

End 

Begin Menu IDM_TRANS_SEP2 
Caption * 

End 

Begin Menu 3DM_TRANS_FINDGAP 

Caption = "Find Next Frame &Gap" 

End 

Begin Menu I DM_TRANS_NEXTBOUND 

Caption = "Find &Next File Boundary" 

End 

Begin Menu I DM_TRANS_PREVBOUND 

Caption = "Find ^Previous File Boundary" 

End 

End 

Begin Menu IDM_PLAYER 

Caption = "&Player" 

Begin Menu I DM_PLAYER_SHOW 

Caption = "fcHide" 

End 

Begin Menu I DM_PLAYER_SEP1 
Caption 

End 

Begin Menu IDM_PLAYER_OPEN 

Caption » "&Open. . . " 

End 

Begin Menu IDM_PLAYER_CLOSE 

Caption = "fcClose" 

End 

Begin Menu IDM_PLAYER_SEP2 
Caption = 

End 

Begin Menu I DM_P LA YER_P LAY 
Caption = "&Play" 

Shortcut = A P 

End 
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TRNSCRPT . FRM - 6 

Begin Menu IDM_P. £R_STOP 

Caption = "&Stop" 

Shortcut = A S 

End 

Begin Menu IDM_PLAYER_REFRESH 
Caption = "^Refresh" 

Shortcut = A R 

End 

Begin Menu IDM_PLAYER_SEP3 
Caption = " -" 

End 

Begin Menu IDM_PLAYER_GOTOFRAME 

Caption - "Go to fcFrame . . . 11 

End 

Begin Menu IDM_PLAYER_MATCH 

Caption = "ficMatch Video to Current Line" 

End 

End 

End 
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pGo to Transcript Un 
: £age: ] [ j line: | 1 



□ bOkay 



trnsgoto.bmp 
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TRNSGOTO . FRM 



False 
False 



VERSION 2.00 
Begin Form TransGoto 

BorderStyle 

Caption 

ClientHeight 

ClientLeft 

ClientTop = 

ClientWidth 

ClipControls 

ControlBox 

Height 

Left 

LinkTopic 
MaxButton 
MinButton 
ScaleHeight = 
ScaleWidth 
Top = 
Width 

Begin TextBox txtLine 
FontBold = 
Fontltalic 
Font Name = 
FontSize 

FontStrikethru - 
FontUnderline « 
Height 
Left 

Tab Index 
Top 
Width 

End 

Begin CheckBox bOkay 
Caption 
Height 
Left 

Tablndex 

Top = 
Visible 
Width 
End 

Begin CommandButton btnCancel 



3 1 Fixed Double 
"Go to Transcript Line" 
1110 
2620 
4800 
2805 
0 
0 

1515 
2760 
"For ml •* 
0 'False 
0 'False 
1110 
2805 
4455 
2925 



0 'False 
0 'False 
"Arial" 
8.25 

0 'False 
0 'False 
315 
2145 
3 

180 
465 



"bOkay" 
315 
1290 
6 

1620 

0 'False 
975 



Cancel 
Caption 
Height 
Left 

Tablndex 

Top 

Width 



-1 'True 

"Cancel" 

330 

1500 

5 

660 
975 



End 
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TRNSGOTO . FRM 



Begin CommandButton 
Caption = 
Default 
Height 
Left 

Tablndex 

Top 

Width 

End 

Begin TextBox txtPage 
FontBold 
Fontltalic 
FontName = 
FontSize 
FontStrikethru 
FontUnderiine = 
Height 
Left 

Tablndex 

Top = 
Width 

End 

Begin Label lblLine 
Caption 
Height 
Left 

Tablndex = 
Top = 
Width 

End 

Begin Label lblPage 
Caption = 
Height 
Left 

Tablndex = 

Top 

Width 

End 



'True 



n&Xr 
"OK" 
-1 
330 
330 
4 

660 
975 



0 'False 
0 'False 
"Arial" 
8.25 



1 False 
' False 



0 
0 

315 
855 
1 

180 
465 



»&Line: " 
300 
1590 
2 

225 
495 



»&Page: " 

300 

225 

0 

225 
570 



End 
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B ™ Stale mm 



^TransFlerame 




I 


a. [sEyaynto^ < J. tTramcf ^ 


^TrarwUnejPerPage 




^iTransStartinoPage 






jsExhWtManw 






sSyncnename ['.'.WW','. 


|ExNbBFrame 


nSyncHeOroup ; 


jFranwUst 


; nSyncStortUie 


jlTransLhcs 


• nSyncEndUne 


jtSyncStartframe 




* tSync&idFramc 









tvistate .bmp 



12/22/2003, EAST version: 1.4.1 



309 



5,832,171 



310 



TV I STATE . FRM 



VERSION 2,00 
Begin Form TV I 
BorderStyle 
Caption 
ClientHeight 
ClientLeft 
ClientTop 
ClientWidth 
Control Box 
Height 
Icon 
Left 

LinkTopic 

MaxButton 

ScaleHeight 

ScaleWidth 

Top 

Visible 
Width 



1 ' Fixed Single 

"TVI State" 

3855 

1740 

1965 

5670 

0 'False 

4260 

(Icon) 

1680 

n Forml " 

0 'False 

3855 

5670 

1620 

0 'False 
5790 



Begin ListBox sTranscripts 



Height 
Left 

Tablndex 

Top 

Width 



1005 

4695 

16 

180 

885 



End 

Begin ListBox 1 Sync End Frame 



FontBold 

Fontltalic 

FontName 

FontSize 

Fonts trikethru 

FontUnderline 

Height 

Left 

Tablndex 

Top 

Width 



0 'False 
0 'False 
"Arial" 
8.25 

0 'False 

0 'False 

450 

2580 

15 

3285 
1920 



End 

Begin ListBox lSyncStartFrame 



FontBold 

Fontltalic 

FontName 

FontSize 

Fonts trikethru 

FontUnderline 

Height 

Left 

Tablndex 
Top 



0 'False 
0 'False 
"Arial" 
8.25 



0 
0 

450 
135 
14 

3300 



False 
False 
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TVISTATE . FRM - 2 

Width *- 1920 

End 

Begin ListBox lTransLines 



FontDold 




0 


False 


Fontltalic 




0 ' 


1 False 


FontName 




"Arial" 


FontSize 




B.25 




FontStrikethru 




0 


■False 


FontUnderline 




0 


1 False 


Height 




450 




Left 




135 




Tablndex 




1 




Top 


2 


2760 




Width 




1920 





End 

Begin ListBox lFrameList 



FontBold 


B 


0 ' 


■False 


Fontltalic 




0 


'False 


FontName 




"Arial" 


FontSize 


a 


8.25 




FontStrikethru 




0 


■False 


FontUnderline 




0 


'False 


Height 


s 


450 




Left 




120 




Tablndex 


= 


4 




Top 




2205 




Width 




1920 





End 

Begin ListBox nSyncEndLine 

FontBold - 0 ' False 

Fontltalic = 0 'False 

FontName = "Arial" 

FontSize = 8.25 

FontStrikethru = 0 'False 

FontUnderline - 0 » False 

Height - 450 

Left = 2580 

Tablndex = 9 

Top = 2760 

Width = 1920 

End 

Begin ListBox nSyncStartLine 

FontBold = 0 'False 

Fontltalic = 0 1 False 

FontName = ".Arial " 

FontSize = 8.25 

FontStrikethru » 0 'False 

FontUnderline » 0 'False 

Height - 4 50 

Left = 2595 
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TV I STATE . FRM 



Tab Index 

Top 

Width 



13 

2220 
1920 



End 

Begin ListBox nSyncFileGroup 



FontBold 

Fontltalic 

FontName 

FontSize 

Font Strike thru 

Font Under line 

Height 

Left 

Tablndex 

Top 

Width 



0 'False 
0 'False 
"Arial" 
8.25 

0 'False 

0 'False 

450 

2610 

12 

1710 
1920 



End 

Begin ListBox sSyncFilename 



FontBold 




0 'False 


Fontltalic 




0 'False 


FontName 


= 


-Arial" 


FontSize 




8.25 


FontStrikethru 




0 'False 


FontUnderline 




0 'False 


Height 




450 


Left 


— 


2595 


Tablndex 




11 


Top 




1170 


Width 




1920 



End 

Begin ListBox lExhibitFrame 



FontBold 




0 'False 


Fontltalic 




0 'False 


FontName 




"Arial" 


FontSize 




8.25 


FontStrikethru 


E3 


0 'False 


FontUnderline 




0 'False 


Height 




450 


Left 




120 


Tablndex 




8 


Top 




1710 


Width 




1920 



End 

Begin ListBox sExhibitName 

FontBold = 0 'False 

Fontltalic = 0 'False 

FontName = "Arial" 

FontSize = 8.25 

FontStrikethru « 0 'False 

FontUnderline = 0 "False 
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a$ Height 450 
/' Left = 120 



Tab Index = 7 

Top = 1200 

Width - 1920 

End 

Begin CommonDialog Cdlg 

Left = 2205 

Top - 135 

End 

Begin Label sSyncMediaName 

BorderStyle - 1 'Fixed Single 

Caption = "sSyncMediaName" 

FontBold - 0 ' False 

Fontltalic » 0 'False 

FontName « u Arial" 

FontSize = 8.25 

FontStrikethru = 0 "False 

FontUnderline - 0 'False 

Height = 270 

Left = 2865 

Tablndex = 10 

Top = 82 5 

Width = 1620 

End 

Begin Label nExhibitFileGroup 

BorderStyle = 1 ' Fixed Single 

Caption = "nExhibitFileGroup" 

FontBold = 0 'False 

Fontltalic = 0 'False 

FontName * "Arial" 

FontSize = 8.25 

FontStrikethru = 0 'False 

FontUnderline o 0 'False 

Height =• 270 

Left - 2880 

Tablndex = 6 

Top = 435 

Width = 1620 

End 

Begin Label sExhibitFilename 

BorderStyle = 1 'Fixed Single 

Caption = "sExhibitFilename" 

FontBold = 0 'False 

Fontltalic = 0 'False 

FontName = "Arial" 

FontSize = 8.25 

FontStrikethru - 0 'False 

FontUnderline - 0 'False 

Height = 270 
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TV I STATE . FRM - 5 



Left * 2880 

Tablndex - 5 

Top = 75 

Width = 1620 

End 

Begin Label nTransStartingPage 

BorderStyle = 1 'Fixed Single 

Caption = "nTransStartingPage" 

FontBold - 0 'False 

Fontltalic = 0 'False 

FontName = "Arial" 

FontSize = 8.25 

FontStrikethru = 0 'False 

FontUnderline = 0 • False 

Height = 3 00 

Left - 135 

Tablndex = 3 

Top - 855 

Width - 1950 

End 

Begin Label nTransLinesPerPage 

BorderStyle = 1 'Fixed Single 

Caption = "nTransLinesPerPage" 

FontBold = 0 'False 

Fontltalic = 0 'False 

FontName = "Arial" 

FontSize «= 8.25 

FontStrikethru = 0 'False 

FontUnderline = 0 'False 

Height = 315 

Left » 135 

Tablndex = 2 

Top = 450 

Width « 1920 

End 

Begin Label sTransFilename 

BorderStyle = 1 1 Fixed Single 

Caption = "sTransFilename" 

FontBold = 0 'False 

Fontltalic = 0 'False 

FontName = "Arial" 

FontSize = 8.2 5 

FontStrikethru = 0 'False 

FontUnderline = 0 'False 

Height - 270 

Left = 150 

Tablndex - 0 

Top = 105 

Width = 1920 

End 
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TVISTATE . FRM - 6 
End 
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Verifying Sync Information... 



Type of Validation 


Pass/Fall 


Remedy 


Transcript Information is Complete 


□ □ 


Transcript Inforoation: FH in 
all information and scan the 
tiara cripi file. • • ■ • 


Video File Lengths are Set 


□ □ 


Sync Video: Open aU video 
fUes. (Length is determined . 
when a file it opened.) 


Transcript has no Sync Frame Gap 


* □ □ 


Sync Video: Find gaps and 
sync those transcript Eras. 


Sync Frames are in Ascending 
Order within each Video File 


□ □ 


Sync Video: Validate to find • • • • 
frames that are out of order 
and re-sync those frame*. 


Video File Line Ranges do not 
Overlap 


□ □ 


Sync Video: Validate to find . 
frames that are out of order ■ 
and re-sync those frames! 


Video File Line Ranges are in 
Ascending Order 


□ □ 


Video Files Use Use Move Up ; 
and Move Down buttons to 
change the file order. Check 
the Line Range Held to ensure 
that transcript lines are in 
ascending order. 


CD ROM Numbers have No Gaps 
and are in Ascending Order 

_V ' fMttap^JfflaHMIBiaaM^fiSRBtri ::::::: 


□ □ 


Video Files List: Change CO 
ROM Numbers so that there 
are no gaps and they go in 
ascending order. 

jjUgPWMMftw 

Valid 



verify.bmp 



12/22/2003, EAST Version: 1.4.1 



321 



5,832,171 



323 



324 



VERIFY . FRM - 1 



VERSION 2.00 
Begin Form Verify 

BorderStyle = 3 'Fixed Double 

Caption = "Verifying Sync Information..." 

ClientHeight « 5895 

ClientLeft » 240 

ClientTop = 570 

ClientWidth = 9030 

ControlBox » 0 'False 

Height - 6300 

Left = 180 

LinkTopic = "Forml" 

MaxButton = 0 'False 

MinButton = 0 ' False 

ScaleHeight = 5895 

ScaleWidth * 9030 

Top - 225 

Width = 9150 

Begin CommandButton btnCancel 

Caption = "Return to Main Window" 

Enabled = 0 'False 

Height - 315 

Left = 1305 

Tablndex - 29 

Top « 603 0 

Width = 2655 

End 

Begin PictureBox P 

BorderStyle = 0 "None 

Height = 480 

Index * 6 

Left = 5205 

Picture = (Bitmap) 

ScaleHeight = 480 

ScaleWidth = 975 

Tablndex = 24 

TabStop = 0 'False 

Top = 5040 

Width = 975 

End 

Begin PictureBox P 

BorderStyle = 0 'None 
Height = 480 

Index = 5 

Left = 5205 

Picture = (Bitmap) 

ScaleHeight = 4 80 

ScaleWidth - 975 

Tablndex => 2 3 

TabStop = 0 'False 
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VERIFY. FRM - 2 



Top 
Width 

End 

Begin PictureBox 
BorderStyle 
Height 
Left 
Picture 
ScaleHeight 
ScaleWidth 
Tablndex 
TabStop 
Top 

Visible 
Width 

End 

Begin PictureBox 
BorderStyle 
Height 
Left 
Picture 
ScaleHeight 
ScaleWidth 
Tablndex 
TabStop 
Top 

Visible 
Width 

End 

Begin PictureBox 
BorderStyle 
Height 
Index 
Left 
Picture 
ScaleHeight 
ScaleWidth 
Tablndex 
TabStop 
Top 
Width 

End 

Begin PictureBox 
BorderStyle 
Height 
Index 
Left 
Picture 
ScaleHeight 
ScaleWidth 



PX 



POK 



3765 
975 



0 ' None 
480 
1920 
(Bitmap) 
480 
975 
2 

0 'False 
6225 

0 'False 
975 



0 ' None 

480 

615 

(Bitmap) 

480 

975 

8 

0 'False 
6195 

0 'False 
975 



0 'None 

480 

4 

5205 

(Bitmap) 

480 

975 

12 

0 'False 

2925 

975 



0 ' None 

480 

3 

5205 
(Bitmap) 
4B0 
975 
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VERIFY. FRM 



Tab Index ^ 
TabStop = 
Top = 
Width 

End 

Begin PictureBox P 
BorderStyle = 
Height 
Index 
Left 
Picture 
ScaleHeight 
ScaleWidth 
Tab Index 

TabStop = 

Top 

Width 

End 

Begin Timer WaitTime 
Left 
Top 

End 

Begin CheckBox bVali 
Caption 

Height » 
Left 

Tablndex = 

TabStop 

Top 

Visible 
Width 

End 

Begin CommandButton 
Cancel 
Caption 
Default 
Height 
Left 

Tablndex 

Top 

Width 

End 

Begin PictureBox P 
BorderStyle 
Height 
Index 
Left 
Picture 
ScaleHeight 
ScaleWidth 



16 
0 

2190 
975 



False 



0 ' None 

480 

1 

5205 
(Bitmap) 
480 
975 
19 

0 'False 

990 

975 



3915 
-1000 



"Valid" 
235 
6645 
22 

0 'False 
6225 

0 'False 
1560 



btnOJc 
-1 



True 
"Continue " 
- 1 1 True 
330 
5625 
0 

6030 
1800 



0 1 None 

480 

0 

5205 
(Bitmap) 
480 
975 
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VERIFY. FRM 



Tab Index 
TabS top 
Top 
Width 

End 

Begin PictureBox P 
BorderStyle 
Height 
Index 
Left 
Picture 
ScaleHeight 
ScaleWidth 
Tablndex 
Tabs top 
Top 
Width 

End 

Begin Label R 
Caption 
Height 
Index 
Left 

Tablndex 

Top 

Width 

End 

Begin Label R 
Caption 
Height 
Index 
Left 

Tablndex 

Top 

Width 

End 

Begin Label V 
Caption 
FontBold 
Fontltali c 
FontName 
FontSize 
FontStrikethru 
FontUnderline 
Height 
Index 
Left 

Tablndex 

Top 

Width 



14 

0 'False 

375 

975 



0 1 None 

435 

2 

5205 

(Bitmap) 

435 

975 

18 

0 'False 

1635 

975 



"Sync Video: Validate to find frames that are out of o 

675 

4 

6300 
28 

2940 
2670 



"Sync Video: Validate to find frames that are out of o 

675 

3 

6300 
27 

2175 
2670 



"Video File Line Ranges do not Overlap" 

-1 'True 

0 'False 

"MS Sans Serif" 

13 .5 

0 'False 
0 'False 
735 
4 

45 
26 

2940 
4710 
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VERIFY . FRM - 5 
End 

Begin Label V 
Caption 
FontBold 
Fontltalic 
Font Name 
FontSize 
FontStrikethru 
Font Under line 
Height 
Index 
Left 

Tab Index 

Top 

Width 

End 

Begin Line LH 
BorderWidth 
Index 
XI 
X2 
Yl 
Y2 

End 

Begin Line LH 
BorderWidth 
Index 
XI 
X2 
Yl 
Y2 

End 

Begin Line LH 
BorderWidth 
Index 
XI 
X2 
Yl 
Y2 

End 

Begin Line LH 
BorderWidth 
Index 
XI 
X2 
Yl 
Y2 

End 

Begin Label R 
Caption 



"Sync Frames are in Ascending Order within each Video 

-l 'True 

0 'False 

"MS Sans Serif" 

13.5 

0 'False 
0 'False 
735 
3 

60 
25 

2145 
4710 



2 
2 

30 

9030 
1620 
1620 



2 
7 

15 

9045 
5895 
5895 



2 
6 
0 

9030 
4980 
4980 



2 
5 

30 

9060 
3720 
3720 



"Video Files List: Change CD ROM Numbers so that there 



12/22/2003, EAST Version: 1.4.1 



333 



5,832,171 



334 



VERIFY . FRM - 6 

Height 

Index 

Left 

Tab Index 

Top 

Width 

End 

Begin Line LH 
BorderWidth 
Index 
XI 
X2 
Yl 
Y2 

End 

Begin Label R 
Caption 
Height 
Index 
Left 

Tab Index 

Top 

Width 

End 

Begin Line LH 
BorderWidth 
Index 
XI 
X2 
Yl 
Y2 

End 

Begin Label R 
Caption 
Height 
Index 
Left 

Tablndex 

Top 

Width 

End 

Begin Label R 
Caption 
Height 
Index 
Left 

Tablndex 

Top 
Width 

End 



810 
6 

6300 
21 

5025 
2670 



2 
4 
0 

9015 
2880 
2895 



"Video Files List: Use Move Up and Move Down buttons t 

1260 

5 

6300 
20 

3765 
2670 



2 
3 

15 

9015 
2115 
2115 



"Sync Video: Find gaps and sync those transcript lines 

435 

2 

6285 
17 

1650 
2550 



"Sync Video: Open all video files. (Length is determin 

5B5 

1 

6315 
1 

990 
2670 
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VERIFY . FRM - 7 

Begin Label V 
Caption 
FontBold 
Fontltalic 
FontName 
FontSize 
FontStrikethru 
FontUnderline 
Height 
Index 
Left 

Tab Index 

Top 

Width 

End 

Begin Line LH 
BorderWidth 
Index 
XI 
X2 
Yl 
Y2 

End 

Begin Label R 
Caption 
Height 
Index 
Left 

Tablndex 

Top 

Width 

End 

Begin Line LV2 
BorderWidth 
XI 
X2 
Yl 
Y2 

End 

Begin Line LV1 
BorderWidth 
XI 
X2 
Yl 
Y2 

End 

Begin Label V 
Caption 
FontBold 
Fontltalic 



"Video File Lengths are Set" 

- 1 ' True 

0 'False 

"MS Sans Serif" 

13 .5 

0 'False 
0 'False 
450 
1 

60 
13 

1035 
4710 



2 
1 

30 

9030 

960 

960 



"Transcript Information: Fill in all information and s 

600 

0 

6300 
15 
345 
2670 



2 

6255 
6255 
0 

5880 



2 

5175 
5175 
0 

5B80 



"Transcript has no Sync Frame Gaps" 
-1 'True 
0 'False 
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VERIFY. FRM - 8 



FontName 

FontSize 

FontStrikethru 

Font Under line 

Height 

Index 

Left 

Tablndex 

Top 

Width 

End 

Begin Label V 
Caption 
FontBold 
Fontltalic 
FontName 
FontSize 
FontStrikethru 
FontUnderline 
Height 
Index 
Left 

Tablndex 

Top 

Width 

End 

Begin Label V 
Caption 
FontBold 
Fontltalic 
FontName 
FontSize 
FontStrikethru 
FontUnderline 
Height 
Index 
Left 

Tablndex 

Top 

Width 

End 

Begin Label V 
Caption 
FontBold 
Fontltalic 
FontName 
FontSize 
FontStrikethru 
FontUnderline 
Height 



"MS Sans Serif" 
13.5 

0 'False 
0 'False 
405 
2 

30 
11 

1680 
5115 



"CD ROM Numbers have No Gaps and are in Ascending Orde 

- 1 1 True 

0 'False 

"MS Sans Serif" 

13.5 

0 'False 
0 'False 
750 
6 

45 
10 

5055 
4965 



"Video File Line Ranges are in Ascending Order" 

-1 'True 

0 'False 

"MS Sans Serif 

13.5 

0 'False 
0 'False 
735 
5 

75 
9 

3780 
4710 



"Transcript Information is Complete" 

- 1 * True 

0 'False 

"MS Sans Serif" 

13.5 

0 'False 
0 'False 
405 
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VERIFY . FRM - 9 - 

Index 0 
Left = 60 

Tablndex = 7 

Top - 405 

Width = 4950 

End 

Begin Line LH 

BorderWidth = 2 
Index =« 0 

XI . 0 

X2 » 9030 

Yl = 300 

Y2 = 300 

End 

Begin Label lblRemedy 

Caption » "Remedy" 

Height = 195 

Left = 7275 

Tablndex = 5 

Top = 45 

Width « 1215 

End 

Begin Label lblPaaeFail 

Caption = "Pass/Fail" 

Height ^ 195 

Leet = 5310 

Tablndex = 4 

Top - 60 

Width = 855 

End 

Begin Label lblValidate 
Caption = 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label lblBorder 
BorderStyle 
Height 
Left 

Tablndex 
Top 
Width 

End 

End 



of Validation" 



"Type 
195 
1680 
3 

45 

1680 



1 'Fixed Single 
5910 
0 
6 
0 

9030 
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; File Format UuriTech SYHCFite 

; Product H omo: ' ' f^dcoNoto 
; Veiriori: h-04.2 



: pa© Vw won: I : 

: Lowratt Readable Version: ; 
;HignB«* Readable Version: ; fP~| - 



vereion.bmp 
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VERSION. FRM - X 

VERSION 2.00 
Begin Form Version 

Caption = "Version Information" 

ClientHeight = 2430 

ClientLeft » 1080 

ClientTop «= 1470 

ClientWidth = 4545 

Height = 2835 

Left «= 1020 

LinkTopic - "Form2 n 

ScaleHeight = 2430 

ScaleWidth = 4545 

Top = 1125 

Width = 4665 

Begin Label nHiVersion 

BorderStyle = 1 'Fixed Single 

Caption = "1" 

Height = 255 

Left = 2655 

Tablndex «= 11 

Top « 19 95 

Width = 4 05 

End 

Begin Label IblHigheetVersion 

Caption = "Highest Readable Version:" 

Height = 240 

Left = 165 

Tablndex = 10 

Top = 1980 

Width »= 2280 

End 

Begin Label nLoVersion 

BorderStyle « 1 'Fixed Single 

Caption = "1" 

Height = 255 

Left = 2670 

Tablndex = 9 

Top = 1650 

Width » 405 

End 

Begin Label lblLowestVersion 

Caption = "Lowest Readable Version:" 

Height = 240 

Left = 195 

Tablndex = 8 

Top = 1635 

Width = 2280 

End 

Begin Label nFileVersion 

BorderStyle = 1 'Fixed Single 
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VERSION . FRM - 2 



Caption 

Height 

Left 

Tablndex 

Top 

Width 



255 

2655 

7 

1245 
405 



End 

Begin Label lblFileVersion 
Caption = 
Height 
Left 

Tablndex 

Top = 
Width 

End 

Begin Label sVersion 
BorderStyle 
Caption = 
Height 
Left 

Tablndex 

Top a 
Width 

End 

Begin Label lblVersion 
Caption « 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label sFileFormat 



"File Version: " 
240 
195 
6 

1275 
1650 



1 1 Fixed Single 
"1.04.2" 
255 
1905 
5 

855 
2340 



"Version: 
240 
225 
4 

870 
1650 



BorderStyle 
Caption 
Height 
Left 

Tablndex 

Top 

Width 

End 

Begin Label 
Caption 
Height 
Left 

Tablndex 
Top 
Width 

End 

Begin Label 



1 1 Fixed Single 

"JuriTech SYNC File" 

255 

1935 

3 

165 
2340 



lblFileFormat 

"File Format: 
240 
210 
2 

180 
1650 

sProductName 
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VERSION. FRM 



BorderStyle 
Caption 
Height 
Left 

Tablndex 

Top 
Width 

End 

Begin Label 
Caption 
Height 
Left 

Tablndex 
Top 
Width 

End 



1 'Fixed Single 

"VideoNote" 

255 

1905 

1 

495 
2340 



lblProductName 

s» "Product Name: 
240 
210 
0 

510 
1650 



End 
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B " Video Files Ust jdffll 
^position Nome: | ~[ ; 



- I | : lflll^|J^p| : 

;g) ROM NuBtfien | ] \ Lino Range: j ! 

:\MS2M : : i™ 80 Lenoth: I t : 





LtneUtt 




LengthLitt 



vidfiles.bmp 
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VIDFILES . FRM - 1 

VERSION 2.00 

Begin Form VideoFilee 

BorderStyle « 3 'Fixed Double 

Caption = "Video Files List" 

ClientHeight = 4830 

ClientLeft « 1440 

ClientTop » 1800 

Clientwidth = 6315 

ControlBox = 0 'False 

Height = 5235 

Icon » (Icon) 

Left = 1380 

LinkTopic = "Forml" 

MaxButton « 0 'False 

MinButton = 0 'False 

ScaleHeight = 4830 

ScaleWidth = 6315 

Top « 14 55 

Width = 6435 

Begin ListBox LengthList 

Height - 420 

Left = 4005 

Tab Index = 20 

Top - 5040 

Visible = 0 'False 

Width = 1335 

End 

Begin ListBox LineList 

Height = 420 

Left = 780 

Tablndex = 17 

Top = 5 025 

Visible •= 0 'False 

Width = 1335 

End 

Begin TextBox .txtGroup 

FontBold = 0 'False 

Fontltalic - 0 'False 

Font Name = " Ari a 1 " 

FontSize = 8.25 
FontStrikethru = 0 'False 
FontUnderline = 0 'False 

Height = 315 

Left = 1785 

Tablndex ■ 12 

Top = 3 930 

Width «» 660 

End 

Begin CommandButton btnCancel 

Cancel - -1 'True 
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VIDFILES . FRM - 2 

Caption =. " Cancel" 

Height = 315 

Left = 1395 

Tablndex » 14 

Top « 4425 

Width « 900 

End 

Begin CommandButton btnOk 

Caption = "OK" 

Default - -1 'True 

Height - 315 

Left - 195 

Tablndex = 13 

Top o 44 2.5 

Width = 900 

End 

Begin CommandButton btnBrowse 

Caption = "&Browse . . . " 

Height = 300 

Left = 4935 

Tablndex » 10 

Top = 3525 

Width = 1215 

End 

Begin CommandButton btnDelete 

Caption = "De&lete File" 

Height = 300 

Left = 4920 

Tablndex =» 7 

Top = 2670 

Width = 1215 

End 

Begin CommandButton btnAdd 

Caption = " &Add File. . . " 

Height = 315 

Left - 4905 

Tablndex = 6 

Top = 2175 

Width = 1245 

End 

Begin CommandButton btnMoveDown 

Caption = "Move &Down" 

Height « 315 

Left = 4905 

Tablndex - 5 

Top = 1350 

Width = 1275 

End 

Begin CommandButton btnMoveUp 

Caption = "Move &Up" 
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VIDFILES . FRM - 3 

Height - 315 

Left » 4875 

Tablndex = 4 

Top - B65 

Width = 1305 
End 

Begin TextBox txtFilename 

FontBold = 0 'False 

Fontltalic - 0 ' False 

FontName = "Arial " 

FontSize - 8.25 

FontStrikethru = 0 ' False 

FontUnderline - 0 'False 

Height = 315 

Left = 1125 

Tablndex - 9 

Top = 354 0 

Width * 3615 

End 

Begin ListBox VideoList 

FontBold = 0 'False 

Fontltalic = 0 1 False 

FontName » "Courier New" 

FontSize = 9^ 

FontStrikethru = 0 1 False 

FontUnderline = 0 ' False 

Height = 2505 

Left » 105 

Tablndex = 3 

Top = 795 

Width = 4635 

End 

Begin TextBox txtDepositionName 

FontBold ~ 0 'False 

Fontltalic « 0 ' False 

FontName » "Arial" 

FontSize = 8,25 

FontStrikethru = 0 'False 

FontUnderline = 0 ' False 

Height - 315 

Left = 2055 

Tablndex » 1 

Top = 120 

Width * 4110 

End 

Begin Label txtLength 

BorderStyle = 1 'Fixed Single 

FontBold = 0 'False 

Fontltalic = 0 'False 

FontName = "Arial" 
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VIDFILES . FRM - 4 



.25 



False 
False 



FontSize 

FontStrikethru « 
FontUnderline = 
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While the resultant product made by the process described 
above is output onto a diskette and one or more CD-ROMS, 
it is within the scope of the invention to output the entire 
product onto one or more CD-ROMs. Since ASCII tran- 
scripts and the SYNC and optional PRESYNC files are 
relatively small in comparison to the video files, a small 
amount of space on the CD-ROM may be reserved for the 
information and data normally stored on the diskette. It is 
also within the scope of the invention to store the video 
product on other forms of random access storage media of 
suitable capacity and retrieval speed. CD-ROMs are the 
currently preferred storage medium. While the embodiment 
of the invention described above stores the converted text 
and index information (SYNC and PRESYNC files) on a 
different diskette than the diskette holding the original 
transcript, the converted text and index information may 
also be stored on the diskette holding the original transcript, 
if sufficient space exists on the original transcript diskette. 

The process of the present invention is also adaptable to 
digital video camera systems. These systems capture video 
in digital form on a randomly accessible digital storage 
medium, instead of on a linear tape. When such a system is 
used, it may not be necessary to make a second video 
recording because the original recording is already on a 
random access storage medium and most likely already 
includes sequentially numbered video frames. In this 
instance, the original video record may be used as the 
CD-ROM 10 in the present invention. Alternatively, the 
original video record may not be in the exact format usable 
by the present invention. In this case, the original video 
record is processed to place it in suitable form, and then 
copied onto a second random access video storage medium 
(CD-ROM 10) for use in the remaining steps of the present 
invention. 

The present invention may be used for synchronizing a 
videotaped event that has not been transcribed. The tran- 
script can be created while simultaneously creating the 
SYNC file. The present invention may also be used for 
synchronizing events where no video picture may even exist 
for the event, such as an untranscribed wiretap recording. 
Furthermore, the present invention may also be used for 
synchronizing a videotaped event that may have already 
been transcribed, such as a speech, a commercial, a televi- 
sion show, or a closed caption program. 

It will be appreciated by those skilled in the art that 
changes could be made to the embodiments described above 
without departing from the broad inventive concept thereof. 
It is understood, therefore, that this invention is not limited 
to the particular embodiments disclosed, but it is intended to 
cover modifications within the spirit and scope of the present 
invention as defined by the appended claims. 

1 claim: 

1. A method of creating a video product with synchro- 
nized video and text of an event, a first video record of the 
event having been made on a first storage medium and an 
original transcript of the event having been made on a 
second storage medium, the second storage medium being a 
random access medium, the original transcript containing 
spoken word information and format information, the format 
information including page and line numbers, the method 
comprising the steps of: 

(a) generating a converted transcript which includes only 
the spoken word information, but which maintains the 
same lines of spoken word information as in the 
original transcript, the lines of the converted transcript 
being sequentially numbered and having a predeter- 
mined relationship to the page and line numbers of the 
original transcript; 
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(b) making a second video record on a third storage 
medium from the first video record, the second video 
record having sequentially numbered video frames, the 
third storage medium being a random access storage 

5 medium; 

(c) displaying the converted transcript on a computer 
while playing the second video record on the same 
computer; 

(d) signalling to the computer at each line of the converted 
10 transcript when the second video record matches the 

current line of text of the converted transcript; 

(e) creating an index of the page and line numbers of the 
original transcript to the video frames of the second 
video record from the signals in step (d) and the video 

is frame information, the page and line numbers being 
recreated from the converted transcript lines and the 
predetermined relationship therebetween; and 

(f) storing the index and the converted transcript on a 
fourth storage medium, the fourth storage medium 

20 being a random access medium, the third and fourth 
storage media together being the video product and 
being usable together to simultaneously play back the 
second video record, the corresponding transcript, and 
the original page and line numbers by using the index 

25 on the fourth storage medium. 

2. A method according to claim 1 wherein the signalling 
in step (d) is performed by an operator. 

3. A method according to claim 2 wherein the operator 
signals at the end of each line. 

30 4. A method according to claim 1 wherein the format 
information further includes party identifying information or 
transcript service identifying information. 

5. A method according to claim 1 wherein step (c) 
includes displaying the converted transcript while listening 

35 to the second video record, or while viewing and listening to 
the second video record. 

6. A method according to claim 1 wherein step (d) further 
includes locating an initial synchronization point of the 
converted transcript and the second video record, scrolling 

40 line-by-line through the converted transcript and signalling 
to the computer at each line of the converted transcript when 
the second video record matches the current line of text of 
the converted transcript. 

7. A method according to claim 1 wherein step (c) 
45 includes displaying the page and line numbers of the original 

transcript, the page and line numbers being recreated from 
the converted transcript lines and the predetermined rela- 
tionship therebetween. 

8. A method according to claim 1 wherein the third 
so storage medium is a CD-ROM. 

9. A method according to claim 1 wherein the fourth 
storage medium is a diskette. 

10. A method according to claim 1 wherein the event is a 
legal proceeding. 

55 11. A method according to claim 1 wherein the first 
storage medium is an analog, serially recorded storage 
medium. 

12. A method according to claim 1 wherein the lines of the 
converted transcript are sequentially numbered from 1 to n. 

60 13. A method according to claim 1 wherein the third and 
fourth media are the same. 

14. A method of creating a video product with synchro- 
nized video and text of an event, a first video record of the 
event having been made on a first storage medium, the first 

65 video record including time or SMPTE information, an 
original transcript of the event having been made on a 
second storage medium, the second storage medium being a 
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random access medium, the original transcript containing 
spoken word information, time or SMPTE information per 
line, and format information, the time or SMPTE informa- 
tion of the original transcript being identical to the time or 
SMPTE information of the first video record, the format 5 
information including page and line numbers, the method 
comprising the steps of: 

(a) generating a converted transcript which includes only 
the spoken word information, but which maintains the 
same lines of spoken word information as in the 10 
original transcript, the lines of the converted transcript 
being sequentially numbered and having a predeter- 
mined relationship to the page and line numbers of the 
original transcript; 

(b) generating a first file containing the time or SMPTE ^ 
code information for each line of the original transcript; 

(c) making a second video record on a third storage 
medium from the first video record, the second video 
record having sequentially numbered video frames, the 
third storage medium being a random access storage 
medium; 20 

(d) generating a second file containing the time or SMPTE 
code information for each numbered frame of the 
second video record; 

(e) automatically creating an index of the page and line 
numbers of the original transcript to the video frames of 25 
the second video record from the first and second files 

of time or SMPTE information, the page and line 
numbers being recreated from the converted transcript 
lines and the predetermined relationship therebetween; 
and 30 

(f) storing the index and the converted transcript on a 
fourth storage medium, the fourth storage medium 
being a random access medium, the third and fourth 
storage media together being the video product and 
being usable together to simultaneously play back the 35 
second video record, the corresponding transcript, and 
the original page and line numbers by using the index 
on the fourth storage medium. 

15. A method according to claim 14 wherein the format 
information further includes party identifying information or 40 
transcript service identifying information. 

16. A method according to claim 14 wherein the third 
storage medium is a CD-ROM. 

17. A method according to claim 14 wherein the fourth 
storage medium is a diskette. 45 

18. A method according to claim 14 wherein the event is 
a legal proceeding. 

19. A method according to claim 14 wherein the first 
storage medium is an analog, serially recorded storage 
medium. 50 

20. A method according to claim 14 wherein the lines of 
the converted transcript are sequentially numbered from 1 to 
n. 

21. A method according to claim 14 wherein the third and 
fourth media are the same. 55 

22. A method according to claim 14 wherein the first and 
second files are part of a single file structure. 

23. A method of creating a video product with synchro- 
nized video and text of an event, a first video record of the 
event having been made on a first storage medium and an 60 
original transcript of the event having been made on a 
second storage medium, the second storage medium being a 
random access medium, the original transcript containing 
spoken word information, time or SMPTE information per 
line, and format information, the format information includ- 65 
ing page and line numbers, the method comprising the steps 
of: 
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(a) generating a converted transcript which includes only 
the spoken word information, but which maintains the 
same lines of spoken word information as in the 
original transcript, the lines of the converted transcript 
being sequentially numbered and having a predeter- 
mined relationship to the page and line numbers of the 
original transcript; 

(b) generating a file containing the time or SMPTE code 
information for each line of the original transcript; 

(c) making a second video record on a third storage 
medium from the first video record, the second video 
record having sequentially numbered video frames, the 
third storage medium being a random access storage 
medium; 

(d) locating an initial synchronization point of the con- 
verted transcript and the second video record; 

(e) automatically creating an index of the page and line 
numbers of the original transcript to the video frames of 
the second video record from the file of time or SMPTE 
information, the second video record and the initial 
synchronization point, the page and line numbers being 
recreated from the converted transcript lines and the 
predetermined relationship therebetween; and 

(f) storing the index and the converted transcript on a 
fourth storage medium, the fourth storage medium 
being a random access medium, the third and fourth 
storage media together being the video product and 
being usable together to simultaneously play back the 
second video record, the corresponding transcript, and 
the original page and line numbers by using the index 
on the fourth storage medium. 

24. A method according to claim 23 wherein the format 
information further includes party identifying information or 
transcript service identifying information. 

25. A method according to claim 23 wherein the third 
storage medium is a CD-ROM. 

26. A method according to claim 23 wherein the fourth 
storage medium is a diskette. 

27. A method according to claim 23 wherein the event is 
a legal proceeding. 

28. A method according to claim 23 wherein the first 
storage medium is an analog, serially recorded storage 
medium. 

29. A method according to claim 23 wherein the lines of 
the converted transcript are sequentially numbered from 1 to 
n. 

30. A method according to claim 23 wherein the third and 
fourth media are the same. 

31. A method according to claim 23 wherein the index 
created in step (g) is an initial index, the method further 
comprising the step of: 

(g) viewing the video product to detect any discontinuity 
between the video and corresponding transcript and if 
a discontinuity is detected, 

(h) locating a subsequent synchronization point of the 
converted transcript and the second audio -visual 
record, and 

(i) repeating steps (g) and (h) to automatically create a 
modified index, the modified index being stored in 
place of the initial index. 

32. A method of creating a video product with synchro- 
nized video and text from an event, 

(a) receiving in a computer 

(i) a video output of a video capturing device, and 

(ii) an output of a computer-aided transcription device, 
the output including lines of spoken word 



12/22/2003, EAST Version: 1.4.1 



5,832,171 



379 



380 



10 . 



IS 



25 



information, page and line numbers corresponding to 
the lines of spoken word information and end of line 
signals; 

(b) automatically creating in the computer an index of the 
page and line numbers to sequentially numbered video s 
frames, the sequentially numbered video frames repre- 
senting the video output which occurs al the same 
instance of time as the end of each line from the device; 

(c) storing the video output on a first random access 
storage medium; and 

(d) storing the index and the output of the device on a 
second random access storage medium, the first and 
second storage media together being the video product 
and being usable together to simultaneously play back 
a video of the event, the corresponding transcript, and 
the original page and line numbers by using the index 
on the second storage medium. 

33. A method according to claim 32 wherein the event is 
a live event and steps (a)-(d) occur while the live event 
proceeds. 

34. A method according to claim 32 wherein the event is 
a past event captured on a video storage medium, and steps 
(a)-(d) occur while playing back the past event from the 
video storage medium. 

35. A method according to claim 32 wherein the first 
random access storage medium is a CD-ROM. 

36. A method according to claim 32 wherein the second 
random access storage medium is a diskette. 

37. A method according to claim 32 wherein the event is 
a legal proceeding. 

38. An apparatus for creating a video product with syn- 
chronized video and text of an event, a first video record of 
the event having been made on a first storage medium and 
an original transcript of the event having been made on a 
second storage medium, the second storage medium being a 
random access medium, the original transcript containing 
spoken word information and format information, the format 
information including page and line numbers, the apparatus 
comprising: 

(a) means for generating a converted transcript which 
includes only the spoken word information, but which 
maintains the same lines of spoken word information as 
in the original transcript, the lines of the converted 
transcript being sequentially numbered and having a ^ 
predetermined relationship to the page and line num- 
bers of the original transcript; 

(b) means for making a second video record on a third 
storage medium from the first video record, the second 
video record having sequentially numbered video 5Q 
frames, the third storage medium being a random 
access storage medium; 

(c) a computer for displaying the converted transcript and 
simultaneously playing the second video record; 

(d) a signalling device for outputting signals to the 55 
computer at each line of the converted transcript when 
the second video record matches the current line of text 

of the converted transcript; 

(e) means for creating an index of the page and line 
numbers of the original transcript to the video frames of en 
the second video record from the output signals and the 
video frame information, the page and line numbers 
being recreated from the converted transcript lines and 
the predetermined relationship therebetween; and 

(f) means for storing the index and the converted tran- 65 
script on a fourth storage medium, the fourth storage 
medium being a random access medium, the third and 
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fourth storage media together being the video product 
and being usable together to simultaneously play back 
the second video record, the corresponding transcript, 
and the original page and line numbers by using the 
index on the fourth storage medium. 

39. An apparatus according to claim 38 wherein the third 
storage medium is a CD-ROM. 

40. An apparatus according to claim 38 wherein the fourth 
storage medium is a diskette. 

41. An apparatus according to claim 38 wherein the event 
is a legal proceeding. 

42. An apparatus according to claim 38 wherein the first 
storage medium is an analog, serially recorded storage 
medium. 

43. An apparatus according to claim 38 wherein the lines 
of the converted transcript are sequentially numbered from 
1 to n. 

44. An apparatus according to claim 38 wherein the third 
and fourth media are the same. 

45. An apparatus for creating a video product with syn- 
chronized text and video of an event, a first video record of 
the event having been made on a first storage medium, the 
first video record including time or SMPTE information, an 
original transcript of the event having been made on a 
second storage medium, the second storage medium being a 
random access medium, the original transcript containing 
spoken word information, time or SMPTE information per 
line, and format information, the time or SMPTE informa- 
tion of the original transcript being identical to the time or 
SMPTE information of the first video record, the format 
information including page and line numbers, the apparatus 
comprising: 

(a) means for generating a converted transcript which 
includes only the spoken word information, but which 
maintains the same lines of spoken word information as 
in the original transcript, the lines of the converted 
transcript being sequentially numbered and having a 
predetermined relationship to the page and line num- 
bers of the original transcript; 

(b) means for generating a first file containing the time or 
SMPTE code information for each line of the original 
transcript; 

(c) means for making a second video record on a third 
storage medium from the first video record, the second 
video record having sequentially numbered video 
frames, the third storage medium being a random 
access storage medium; 

(d) means for generating a second file containing the time 
or SMPTE code information for each numbered frame 
of the second video record; 

(e) means for automatically creating an index of the page 
and fine numbers of the original transcript to the video 
frames of the second video record from the first and 
second files of time or SMPTE information, the page 
and line numbers being recreated from the converted 
transcript lines and the predetermined relationship ther- 
ebetween; and 

(f) means for storing the index and the converted tran- 
script on a fourth storage medium, the fourth storage 
medium being a random access medium, the third and 
fourth storage media together being the video product 
and being usable together to simultaneously play back 
the second video record, the corresponding transcript, 
and the original page and line numbers by using the 
index on the fourth storage medium. 

46. An apparatus according to claim 45 wherein the third 
storage medium is a CD-ROM. 
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47. An apparatus according to claim 45 wherein the fourth 
storage medium is a diskette. 

48. An apparatus according to claim 45 wherein the event 
is a legal proceeding. 

49. An apparatus according to claim 45 wherein the first 5 
storage medium is an analog, serially recorded storage 
medium. 

50. An apparatus according to claim 45 wherein the lines 
of the converted transcript are sequentially numbered from 

1 to n. 10 

51. An apparatus according to claim 45 wherein the third 
and fourth media are the same. 

52. An apparatus according to claim 45 wherein the first 
and second files are part of a single file structure. 

53. An apparatus for creating a video product with syn- 15 
chronized video and text of an event, a first video record of 
the event having been made on a first storage medium and 

an original transcript of the event having been made on a 
second storage medium, the second storage medium being a 
random access medium, the original transcript containing 20 
spoken word information, time or SMPTE information per 
line, and format information, the format information includ- 
ing page and line numbers, the apparatus comprising: 

(a) means for generating a converted transcript which 
includes only the spoken word information, but which 25 
maintains the same lines of spoken word information as 

in the original transcript, the lines of the converted 
transcript being sequentially numbered and having a 
predetermined relationship to the page and line num 
bers of the original transcript; 

(b) means for generating a file containing the time or 
SMPTE code information for each line of the original 
transcript; 

(c) means for making a second video record on a third 35 
storage medium from the first video record, the second 
video record having sequentially numbered video 
frames, the third storage medium being a random 
access storage medium; 

(d) means for locating an initial synchronization point of 40 
the converted transcript and the second video record; 

(e) means for automatically creating an index of the page 
and line numbers of the original transcript to the video 
frames of the second video record from the file of time 

or SMPTE information, the second video record and 45 
the initial synchronization point, the page and line 
numbers being recreated from the converted transcript 
lines and the predetermined relationship therebetween; 
and 

(f) means for storing the index and the converted tran- 50 
script on a fourth storage medium, the fourth storage 
medium being a random access medium, the third and 
fourth storage media together being the video product 
and being usable together to simultaneously play back 
the second video record, the corresponding transcript, 55 
and the original page and line numbers by using the 
index on the fourth storage medium. 

54. An apparatus according to claim 53 wherein the third 
storage medium is a CD-ROM. 

55. An apparatus according to claim 53 wherein the fourth 60 
storage medium is a diskette. 



56. An apparatus according to claim 53 wherein the event 
is a legal proceeding. 

57. An apparatus according to claim 53 wherein the first 
storage medium is an analog, serially recorded storage 
medium. 

58. An apparatus according to claim 53 wherein the lines 
of the converted transcript are sequentially numbered from 
1 to n. 

59. An apparatus according to claim 53 wherein the third 
and fourth media are the same. 

60. An apparatus according to claim 53 wherein the index 
is an initial index, the apparatus further comprising: 

(g) means for viewing the video product to detect any 
discontinuity between the video and corresponding 
transcript and if a discontinuity is detected, locating a 
subsequent synchronization point of the converted tran- 
script and the second audio -visual record, and 

(h) means for automatically creating a modified index if 
a discontinuity is detected, the modified index being 
stored in place of the initial index. 

61. An apparatus for creating a video product with syn- 
chronized video and text from an event, the apparatus 
comprising: 

(a) a computer for receiving a video output of a video 
capturing device, and an output of a computer-aided 
transcription device, the output including fines of spo- 
ken word information and page and line numbers 
corresponding to the lines of spoken word information; 

(b) means for creating an index of the page and line 
numbers to sequentially numbered video frames, the 
sequentially numbered video frames representing the 
video output which occurs at the same instance of time 
as the end of each line from the device; 

(c) means for storing the video output on a first random 
access storage medium; and 

(d) means for storing the index and the output of the 
device on a second random access storage medium, the 
first and second storage media together being the video 
product and being usable together to simultaneously 
play back a video of the event, the corresponding 
transcript, and the original page and line numbers by 
using the index on the second storage medium. 

62. An apparatus according to claim 61 wherein the event 
is a live event and the video product is created while the five 
event proceeds, the video capturing device being a video 
camera at the live event. 

63. An apparatus according to claim 61 wherein the event 
is a past event captured on a video storage medium, and the 
video product is created while playing back the past event 
from the video storage medium, the video capturing device 
being a video recorder which plays back the video storage 
medium. 

64. An apparatus according to claim 61 wherein the first 
random access storage medium is a CD-ROM. 

65. An apparatus according to claim 61 wherein the 
second random access storage medium is a diskette. 

66. An apparatus according to claim 61 wherein the event 
is a legal proceeding. 
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[57] ABSTRACT 

A wide area information system includes a client and at least 
one server on which audio data is stored. Audio data is 
selectively transferred to the client from the server by at least 
occasionally establishing a transfer connection between the 
server and the client. The transfer of audio data is controlled 
by user-selected commands and inputs that are entered via 
an input interface provided on the client These commands 
and inputs are also transferred to the server via the at least 
occasionally established transfer connection between the 
client and the server. The audio data on the server is 
organized in page units that are cross-linked by way of 
hyperaudio links. The page units are characteristically 
searchable with the use of cyclically repeating directory 
pages of audible directory information. Finally, a data pro- 
tocol is defined for enabling such an audio -based system. 

44 Claims, 3 Drawing Sheets 
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AUDIO-BASED WIDE AREA INFORMATION 
SYSTEM 

BACKGROUND OF THE INVENTION 

1. Field of Invention 

The present invention relates to a wide area information 
system for organizing and accessing information, as well as 
methods for implementation thereof. 

2. Description of Related Art 

The popularity of the World Wide Web (WWW) segment 
of the Internet has risen dramatically in the recent past as the 
general public has become more aware of its existence. 
However, despite its popularity and diversity, audio infor- 
mation plays a noticeably small role on the WWW. 

Current uses of audio on the WWW include the ability to 
download audio segments from certain WWW sites. 
Typically, a user must wait, sometimes for extended periods 
of time, until the entire audio file is transmitted before the 
audio file can be heard. 

A system developed at Texas Instruments, Inc. allows a 
user to access the WWW through a speech interface, thereby 
obviating conventional point and click access to WWW 
hyperlinks. However, this system still requires a visual 
display terminal to show the data being browsed and to 
guide the input of commands. According to the TI system, 
a user can "jump" to different pages by speaking the name 
of a hyperlink. 

It can be seen in the foregoing conventional systems that 
audio is still substantially a secondary object. First, the bulk 
of the information on a WWW page is simply not audio 
information. Second, the user still requires a visual interface 
to enable navigation, even with, for example, the TI speech 
interface. 

This latter issue is a problem when a user does not have 
access to a computer or the like, or is engaged in activities 
that require the user's visual attention, such as driving an 
automobile. 

However it is felt that audio remains an important 
medium for information, and can satisfy heretofore unmet 
demands in wide area information systems. 

However, in applications where attempts have been made 
to use audio as the primary operational medium, such as 
phone menu systems (such as voice mail), such systems 
frequently overwhelm a user by requiring the user to memo- 
rize menu lists, yet presenting so much information in such 
lists that recollection is made difficult or impossible. 

SUMMARY OF THE INVENTION 

It is therefore an object of the invention to provide a 
client-server based wide area information system using 
audio as a primary medium for the information. 

The client, sometimes called the virtual client, according 
to the present invention can play audio files, respond to 
commands input via an interface, and communicate with 
servers to retrieve "pages" of audio information. The client 
may be embodied by any number of devices, such as a 
telephone, a personal computer, a workstation, or a radio. 

Servers provide audio information in units generally 
called audio pages, similar to the WWW. (Later in this 
discussion, a distinction is made between Audio Web pages 
and directory pages.) The audio pages are indexed via a 
directory service. Typically, according to the present 
invention, a searchable directory page is cyclically presented 
to the user. Generally each directory level contains audio 
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links to a sub-directory page. The last level of the directory 
service points to individual audio pages (i.e. Audio Web 
pages) that are registered in the directory service. 
These and other objects and novel features of the present 
s invention will become more apparent from the following 
detailed description, taken in conjunction with the accom- 
panying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

10 FIG. 1 illustrates an audio client according to the present 
invention; 

FIG. 2 schematically illustrates the hierarchy of the direc- 
tory service levels according to the present invention; 
15 FIG. 3 illustrates an option menu "window" from a 
cycling directory page; 

FIG. 4 illustrates a binary searching method usable with 
the present invention; 

FIG. 5 conceptually illustrates the process of navigating a 
20 directory page; and 

FIG. 6 illustrates a Digital HyperRadio system according 
to the present invention. 

DESCRIPTION OF THE PREFERRED 
25 EMBODIMENTS 

The present invention is initially described herein in terms 
of using audio information as the basis of the system. 
However, this is done by way of example only, in order to 
fully illustrate the concepts related to the present invention. 

30 It is explicitly contemplated, as discussed later, that these 
concepts can be applied in other forms or combinations, 
such as multimedia environments. 

FIG. 1 illustrates a virtual audio client, and its role in the 

3s client-server system according to the present invention. 
The virtual audio client (interchangeably referred to 
herein as "client") is the means by which a user navigates the 
Audio Web. As illustrated in FIG. 1, the client can recognize 
several inputs and commands. For example, the client may 

4Q recognize the input of the first five cardinal numbers (one 
through five), and the commands STOP, PLAY, FORWARD, 
BACK, PRESET, DELETE, RETURN, and GO. 

The client is shown in FIG. 1 with an appearance similar 
to a video cassette recorder remote control, with buttons 

4 5 corresponding to the aforementioned inputs. However, this 
is only illustrative, and the actual manner in which the client 
is implemented depends on the tangible device in which the 
client is embodied. That is, the manner in which a user 
"presses" one of the conceptual input buttons shown in FIG. 

50 1 depends on the device being used to access the client. For 
example, a user might use a telephone, a personal computer, 
a workstation, a radio, etc. 

If a telephone is used, for example, the client may be 
implemented by establishing a connection between the tele- 

55 phone and a computing device. The connection may be a 
local (i.e., hardwire) one, or it may be established by dialing 
to a computing facility that communicates with the phone 
via a standard phone connection. 

A user issues commands using the phone by pressing 

60 respective keys on the telephone, with each key on the 
telephone being mapped to correspond to a certain com- 
mand. The standard tones generated by the telephone in 
response to pressing respective number keys are transmitted 
to the computer, which is suitably able (via conventional 

65 sound recognition software) to recognize the tones so as to 
trigger corresponding programs to implement the desired 
command(s). 
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Alternatively, a user verbalizes commands into the phone. A user is provided with a way to search the Audio Web to 

The computer, equipped with suitable voice recognition locate audio pages of interest using a directory service. As 

software (for example, speaker independent with a limited seen in the foregoing hypothetical example, such a naviga- 

vocabulary), would map the recognized spoken command to uon means through the Audio Web is vital. In the example, 

the corresponding command program. 5 the first three pages retrieved were directory pages that were 

If a PC or workstation were used to implement the client, l^f' accordin S t0 the hierarchical structure shown in 

the implementing input device and the computing device ' • «u j- » r i a a * t u 

,, r • • t « i »> w I > . & Once in a page, hyperaudio links are provided to other 

would come in a single package . In this instance, a user (frequently, but not always, associated with related 

might provide input using a graphical interface combined Ejects). As seen above, for example, the user jumped from 

with a mouse-type control device. 30 (he Something New page t0 the A^o^y page using the 

It is emphasized that the foregoing examples are by way appropriate hyperaudio link. Hyperaudio links are generally 

of illustration, and are not meant to limit the means by which analogous to hypertext links in the WWW (and are inter- 

the client according to the present invention may be imple- changeably referred to herein as "audio links"), 

mented. For example, a more extensive discussion of using The user can input commands and other information (via 

radio transceivers appears later in this disclosure. 15 the client) to control navigation through the Audio Web. The 

To give an overview of the Audio Web as contemplated, user could > for example, jump back to the Something New 

the following hypothetical scenario is offered in a dialogue page after finishing with the Anthology page, then back to 

format, illustrating the input provided by a user and the the Bea ^ es P a 6 e again using appropriate navigational 

action of the client and server(s). In the scenario, a user is commands, as discussed below 

. t j j • r> i • . r *• w . *u o *t a .u i 20 The user can also place a bookmark to mark a particular 

interested m finding information about the Beatles Anthol- . • f. . 

(f C 'MR H \ audio page, thereby enabling a direct jump to that page 

ogy ^ rom api ec instead of navigating through one or more directories. 

Client: "Welcome to the Audio Web directory server. We „ t , . • < i ■ 4 * . * 4 4 , , 

. , , r.„ , • l * ♦ c Furthermore, a bookmark list is provided to catalog a user s 

have lots of interesting subiects for you: , ^ & 

XK . Xjff . A , . ,„ selected bookmarks. 
IViartinis JVlice xvlusic! 

User: STOP (by "pressing" the STOP key on the virtual 25 Aud ! 0 P a 8 es ca f, be avl ^ ored and included 

client or verbalizing "Stop") ^. a ^ e merarcnies * ^ so > authors can incorporate hyperaudio 

Client: "Please select one of the following choices: ONE: Hnte in their audio pages. 

Music, TWO: Marine Life, THREE: Libraries, FOUR: Land a standard P rotoco1 for transmitt ^S ™ d *> tracks 

Irrigation, FIVE: Kites" ^ 1 \ n , c . A iiL /?n • . 

it r\ikTri /i « . „ i_ i- ■ .u j\ 30 To let users find pages of interest, the tollo wing schema 

User: ONE (by pressing or verbalizing the command). , . K. , , . . , ,. 

. \ * *i_ • « c .l * j of directories is used. When downloaded, each directory is 

Client: <contacts the appropriate server for the requested c , . . t . „ .. .. 

audio a e> a strcam °* mcnu choices that is cyclically presented to the 

au 10 page> user in an audible manner. The directory format is, of course, 

Server: <sends the audio page over to the client> .„ . c . . . c J ^ \ . ' 

r«v * «v i ♦ j«u ■ j- * ami* j • use-specific, but is preterably intormative, entertaining, and, 

Client: "You selected the music directory. All kinds of music /. J . ^ , c . . . ^ 

, , , c . , 35 most importantly, searchable. The user s first contact with 

can be reached from here! . f /' . 

the Audio Web is with a home directory page 10, similar to 

Baroque<a sample of a baroque piece is played >. a <<home „ Qn ^ (see F[G 2) ^ home 

R £±p a Samp,e ° f r0ck mUS1C ,tack 15 played > - • ' directory page 10 contains hyperaudio links 16 to one or 

. er . „ m n , more sub-directory pages 12. This structure continues for a 

2',^ T° Ur ^', C rf S w are: L ^;,^f' ™ ' « number of levels, forming a hierarchical tree structure such 

™ RE iL JaZZ ' F0UR: Mamb0 ' nVE: PolkaS as the one generally depicted in FIG. 2. The directory pages 

User, iwu 14 (leaf nodes) in a last, or lowermost, level are individual 

Client: contacts the appropriate server for the requested audio pages ^ hav(J been re gi stered in the directory page . 

P a ^ e> .1. Th e stacked "tree" organization shown in FIG. 2 is 

Server: <sends the page over to the chent> ^ desirable becausc the fanout of ^ is k t to a rea sonable 

Client: * Th^ is the Rock page: hear more about the greatest number whil& providing managea ble indexing for a large 

groups of all time: Beatles, . . . number of audio pages. The tree organization used here is 

ii S . er ' !,7 nvTT1 ^ , „ comparable to the B-tree organization commonly used in 

u ient oNE U want t0 g0 10 es ' " " database mana g ement s y stcms - Each audio P a & c has a 

^?. er * , . . • rr, ..50 maximum number of audio links and fixed capacity for 

Client: "Welcome to the Audio Web Magical Mystery Tour! ! audk) informatio[L ^ is advantageous because the user is 

These pages contain a collection of Beatles sound files. not overwhelmed by extraneous information clutter while 

Check out the new Anthology page for the latest Beatles listening to a directory page, and, more importantly, the 

release! number of choices in any given option menu does not 

<a sample of the new Beatles track is played>, . . " 55 become excessive, such that the user is burdened by having 

User: STOP to remember large numbers of choices. 

Client: "Want to visit the ONE: Anthology page, TWO: John Another way to organize the pages according to the 

Lennon page, THREE: Paul McCartney page, FOUR: present invention (not illustrated) is to provide a non-stacked 

George Harrison page, FIVE: Ringo Starr page" plurality of pages in which a given page is linked to at least 

User: ONE 60 one other page by a hyperaudio link, without a stacked 

Client: <contacts the appropriate server for the requested hierarchy. 

page> Each hyperaudio link is associated with a portion of the 

Server: <sends the page over to the client> audio track of an audio page, in the same manner that a 

Client: "<The initial part of the new Beatles track 'Free as hypertext link in the WWW is associated with a highlighted 

a Bird' starts playing>. . . " 65 portion of the text on a page. 

Thus, the system according to the present invention As mentioned above, when a user first connects to an 

requires the following functionality. Audio Web server, the first audio page the user encounters 
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is a home directory page, which is in the form of a repeating 
audio track, generally listing a plurality of hyperaudio links. 
In order to use this directory, the user issues a STOP 
command from the client, (for example, when an audio link 
of interest is heard). The directory then provides an option 5 
menu consisting of the last k (for example, five) hyperaudio 
links located before the STOP command was issued. FIG. 3 
illustrates the concept of the repeating directory page, and, 
more specifically, the set of k hyperaudio links defined in a 
window according to a STOP command issued by the user. 10 

At this point, the user hears a new audio track naming the 
k hyperaudio links. Such an audio track might be as follows: 

"These are your choices at this point: 
One: <name of the 1st hyperaudio link>; 
Two: <name of the 2nd hyperaudio link>; 15 
Three: <name of the 3rd hyperaudio link>. . . " 
up to the kth hyperaudio link. The user then makes a 
selection by inputting the corresponding number via the 
client. The system therefore defines a dynamic option menu 
based on a time-based window of the past k links. It will be 20 
appreciated that this concept of a dynamic window guaran- 
tees that the user will be presented each time with a set of 
k options, regardless of the fanout (i.e. the total number of 
hyperaudio links defined on the given audio page). This is 
advantageous because the user need only deal with a rela- 25 
tively small number of options at any one time, keeping the 
selection thereof manageable. 

However, even with the dynamic window concept, a user 
still could be faced with listening to a large list of hyperaudio 
links before finding a topic of interest. 30 

Therefore, according to the present invention, a method is 
provided for facilitating searching through directory pages. 
In particular, a binary search methodology is useful here. 
Binary searching is known as a recursive way to quickly 
search through ordered items. 35 

FIG. 4 is a general illustration of the binary search 
methodology. In the first "pass", the search starts from the 
item i m at the middle of the list. If ^ is "bigger than" (for 
example, numerically greater than, or alphabetically after) 
the item i r being sought, the search is moved to the "left" of 40 
the middle of the list, toward the "lower" end of the list. On 
the other hand, if i^ is "smaller than" (for example, numeri- 
cally smaller than, or alphabetically preceding) the item 
being sought, the search is moved to the "right" of the 
middle of the list, toward to the "higher" end. 45 

Generally, each move is to the middle of one of the 
subportions defined by the middle point at the start of the 
pass. Therefore, in the first pass illustrated in FIG. 4, the 
move is, in general, made from the middle of the entire list 
i mt to the middle of one of the two subportions (in this case, 50 
halves) defined by i m , where each of these subportions 
extends between i m and one of the ends of the entire list. 

Thus, as illustrated in FIG. 4, in the first pass, a decision 
is made that i r <\ m . Therefore, the first move is made to the 
left from i m to i 1( where i A is the item midway between the 55 
end of the list and item i m . 

In the second pass, a decision is made that i r >i r 
Therefore, the second move is made to the right from i 1 to 
i r , since item i r is midway between i 1 and i m . Since i r 
happens to be the item being sought, the search is complete. 60 

The recursive "narrowing down" process continues as 
necessary to arrive at the item being sought. It is known that 
the number of passes necessary is proportional to the loga- 
rithm of the size (number of items) of the entire list. 

As applied to the present invention, the binary search is 65 
used in a browsing/searching system in the following man- 
ner. 
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When a user wants to search an audio track (which can be 
done at any time while the audio track is being played), the 
user inputs a BACK or FORWARD command, as appropri- 
ate. In response, the browser locates the middle time point 
t^, between the current time position tj in the audio track and 
the end or start of the audio track, t tf . The browser then plays 
the audio track from t m forward. If the user decides that the 
item being sought is before (i.e., to the "left" of) t m , then a 
BACK command is issued, and the browser plays the audio 
starting from the midpoint between tj and i m . On the other 
hand, if the user decides that the item being sought is after 
(i.e., to the "right" of) t^, then a FORWARD command is 
input, making the audio playback advance to the midpoint 
between t m and t e . 

As was explained relative to FIG. 4, when this approach 
is repeated, the search arrives at the target item relatively 
quickly. When the user finally arrives at the target item, the 
user issues a STOP command. Thereafter, the above- 
described dynamic menu window is built, based on the 
target item. 

Once the user selects a hyperaudio link from the dynamic 
menu window, the corresponding audio page is sent to the 
client from the server, and the above-described process 
begins over. More specifically, if the newly selected audio 
page is a directory, the user will hear again repeated audio 
information, as described above. If the newly selected audio 
page is an Audio Web page, then the user hears the audio 
information contained therein, and can use it as desired. FIG. 
5 illustrates the concept of the navigating the Audio Web 
according to the present invention. 

Audio Web pages are processed in a manner similar to 
directory pages. The only substantive difference is that 
Audio Web pages are not repeated as directory pages are. 
The user receives the information linearly, as presented in 
the description of the page. When hearing this audio 
information, the user can use the STOP command, which 
prompts a menu of choices formed by the last k hyperaudio 
links in the page, as illustrated in FIG. 3. Thereafter, the user 
can select a number corresponding to the hyperaudio link of 
choice, and branch or jump to the new page corresponding 
to that hyperaudio link (see, again, FIG. 5). 

It will be appreciated that, over time, the user will 
probably come across many pages to which he or she will 
wish to return later, but without having to go through the 
relatively time-consuming process of searching through the 
directories. A bookmark, as its name implies, simply 
"marks" a particular page of interest so that it can be jumped 
to directly. Bookmarks may be accumulated in a bookmark 
list that can be organized as a directory page, in the manner 
of the directory pages discussed above. In this context, a 
bookmark list has the same structure as a leaf node in the 
directory structure. 

In order the build the bookmark list, the user can use a 
PRESET command to assign a bookmark to a page of 
interest and add it to the list by adding the name of the page. 
The name of the page may be taken from the name of the 
hyperaudio link pointing to the page or, alternatively, from 
the name provided by (e.g., spoken by) the user, in combi- 
nation with the page address. (Page addressing is discussed 
in more detail below.) 

To retrieve a bookmarked page, the user uses a GO 
command that moves directly to the page in question and 
retrieves it for play. When the desired page is complete, the 
user stops the audio and proceeds to branch out to other 
pages using hyperaudio links on the bookmarked page. 

It will be appreciated that, over time, the bookmark list 
may itself become relatively large, and searching it can 
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become cumbersome. Therefore, binary searching, as 
described above, is again used here to manage the search of 
bookmarks. It is assumed that the bookmark list is ordered 
lexicographically, in order to apply binary searching. 

An issue understandably arises as to how the audio tracks 5 
are played or the speakable commands recognized. 

In the WWW, the Hypertext Transfer Protocol (HTTP) is 
successful because it is stateless. That is, whenever a WWW 
page is accessed, the server on which that page is located 
simply transfers the contents of that page to the client, and 10 
does not "remember" anything about the request thereafter. 
The client, on which the WWW browser runs, handles page 
layout and user interface issues. Therefore, in effect, when a 
hypertext link is selected (" clicked on") by the user, a 
separate network connection is established to bring the 15 
newly selected page to the client. This property makes 
WWW servers "scaleable". 

This feature is also important in the Audio Web, It is 
impractical to have a server connected to the client continu- 
ously while the user is only manipulating a given page. 20 
Continuously remembering the state of connections and 
processing commands from multiple clients would be a 
tremendous burden on servers. Moreover, the system would 
be unscaleable as usage grows. Therefore, a Hyperaudio 
Transfer Protocol (HATP) is provided for the Audio Web and 25 
acts in a manner similar to the HTTP for the WWW. 

It is a particular feature of the present invention that the 
HATP is a connectionless, or stateless, protocol that delivers 
audio pages to the client. 

In the case of the Audio Web, the equivalent to the 30 
Hypertext Markup Language (HTML) will be a Hyperaudio 
Markup Language (HAML) with the following structure: 

pagetype<audio track> 

audio links<i: l/*, t/, hatp address> 
The pagetype indicates whether the page is a directory page 35 
or an Audio Web page. (A distinction is required here 
because directory pages are played cyclically whereas Audio 
Web pages are not.) The description of the hyperaudio links 
in the page is given after the entire audio track. This allows 
the entire audio track to be sent as a unit, preferably in a 40 
convenient data-compressed format (which may be conven- 
tionally known). Hyperaudio links have three components: 
link number (subscript i above), a pair of elapsed time values 
(relative to the beginning of the entire audio track) that 
represent the beginning t, fc and end t ( ' of the portion of the 45 
audio track that serves as the hyperaudio link name, and 
finally, the HATP address of the page to which the hyper- 
audio link points. 

HATP is preferably very similar to HTTP and should be 
a stateless protocol consisting of four stages: 50 

1. Connection: establishment of a data connection by the 
client to a respective server, using a Universal Resource 
Locator (URL). 

2. Request: sending a request message to the server from 55 
the client. 

3. Response: sending a response message to the client 
from the server, 

4. Close: closing the connection after the response mes- 
sage is complete. 60 

Of course, some substantive differences will exist 
between HATP and HTTP, in terms of concepts known in 
HTTP. 

1. The ACCEPT header line specifies HAML as the only 
format accepted by the client. 65 

2. The ACCEPT- ENCODING header line specifies the 
encoding format of the HAML document (e.g., 



x-compress, x-zip, etc.) and the compressing format for 
the audio track (e.g., MPEG). 
3. A method called AUDIOSEARCH is implemented 
instead of TEXTSEARCH, as in HTTP, This permits an 
object to be queried by an audio stream. The search 
form of the GET method is used to query an object. 
Hereinafter, the methods by which the virtual client 
implements the above-described functionality, according to 
the present invention, are discussed. 

Generally, the client runs the HATP protocol to request 
and receive HAML page descriptions. It also recognizes and 
implements the above-described set of commands (e.g., 
STOP, FORWARD, BACK, PLAY, PRESET, etc.). Finally, 
the client plays the audio tracks from Audio Web pages. 

1. The STOP command 

While a page is playing, the user may issue the STOP 
command. At that point the browser stops playing the audio 
track, and builds up the dynamic menu window including 
the last k links in the audio track prior to the point at which 
the STOP command was issued. 

In order to do this, the browser tracks the elapsed time 
from the beginning of the audio track and also records the 
time at which the STOP command was issued. This time is 
represented as t s . Thereafter, the Audio Web browser in the 
client follows the following algorithm. 

Find the first link j in the link list, such that tj b >t s ; 

From link j, and while searching the link list backwards, 
do: 

menu0(to make the menu window initially empty); 
m=l; 

GL (Get Link): next link i, searching backwards if item i 
is in menu yet 

goto ST (if the page has fewer than, for example, 5 
links); 

else, 

insert item<m, link name, link address, t t b , t/>into 
menu. 
m=m+l 

if m<5 (for example) goto GL 
ST: play the menu items in the menu list and wait for choice 
(a number from 1 to 5) 

Retrieve the page pointed to by the link address in entry 
m-choice. 

2. As mentioned above, the FORWARD and BACK 
commands are useful in connection with binary search- 
ing of the directory pages. The browser uses the fol- 
lowing algorithms to implement these commands. 

In terms of elapsed time, t 2 and t r are the beginning and 
ending endpoints, respectively, of an audio track in question, 
with t s being the starting point of the audio track. At the start 
of playback, tj-t^-0. As mentioned above, i r is set equal to 
the end time of the audio track. 

a. When the FORWARD command is issued, the follow- 
ing procedure is followed: 

Stop playing the audio track 

Set t a =t s 

Set t^tj+Q 

Start playing audio from time t s . 

b. If the BACK command is issued, then the following 
procedure is followed: 

Stop playing the audio 
Set t 5 -t m 
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Start playing audio from new time t s . 

3. The RETURN command is used to order the browser 
to retrieve the page that immediately preceded the 
current page. Preferably, the browser maintains a 
memory cache to store the page immediately preceding 
the current page. More preferably, the browser should 
remember the state in which the immediately preceding 
page was left, (by, for example, caching the hyperaudio 
link number to which the user jumped), so that the 
audio track in the immediately preceding page can be 
replayed from the point at which it was left. 

4. The PLAY command is used to resume playback after 
the STOP command is used to stop playback. The 
PLAY command causes playback to restart at the point 
it stopped following the STOP command. 

5. As mentioned above, the PRESET command is used to 
add a new entry to the bookmark list. It causes the 
browser to add a link to the current page in the 
bookmark list, along with the name of the link. The 
browser may, for example, prompt the user to verbalize 
the name of the link in order to add an entry to the 
bookmark list, or it may take the name of the link from 
the page in the memory cache. The bookmarked link is 
entered as an HAML link descriptor, as described 
above. 

6. The GO command prompts the browser to start playing 
back the bookmark list as a repeating stream, thereby 
treating the bookmark list as a variant of the directory 
system described previously. After the GO command is 
used, the system proceeds until the user uses the STOP 
command in order to create a dynamic menu window, 
or the FORWARD or BACK commands to perform a 
binary search of the bookmark list. 

Web pages in the WWW can be queried using text strings. 
Therefore, a WWW page may contain databases of 
information, such as city-by-city weather data, catalogs, and 
the like. A similar feature is provided for the Audio Web, 

According to the present invention, a user queries an 
audio page by sending an audio string and receiving corre- 
sponding audio information in response. When presented 
with such a page, the client waits for the user to verbalize an 
query and send the request to the server using the AUDIO- 
SEARCH method described above. 

Such audio querying requires either accurate, speaker 
independent speech recognition ability with a sizable 
vocabulary, or, in the alternative, means to "approximately 
match" audio streams. 

The concepts related to the Audio Web, as disclosed 
herein, are particularly adaptable to radio listening. 
Therefore, the Digital HyperRadio ("DHR") is also pre- 
sented here in accordance with the present invention. 

In order to illustrate the concept of DHR, a comparison is 
made in FIG. 6 to the radio transmissions of an international 
radio broadcast by, for example, the British Broadcasting 
Corporation ("BBC"). An individual listening to the BBC in 
New York City, for example, would tune a radio to a 
frequency used by a BBC repeater station. Using DHR, 
however, a list of hyperaudio links are broadcast using part 
of the available frequency band, in a manner similar to the 
explanation above. In effect, a radio transmission has the 
format of an Audio Web page using the HAML format. Each 
hyperaudio link points to a respective Audio Web server 
which provides more information about the topic named in 
the link. In this arrangement, therefore, the audible broadcast 
radio transmission consists only of news headlines, for 
example, while the respective full news stories are obtained 
in the Audio Web pages pointed to by the radio transmission 
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"page". Using a specially equipped radio transceiver as the 
client, a listener stops the transmission of the news 
headlines, get a menu of links, select a topic of interest, and 
download the corresponding full news story from an Audio 

s Web server. 

The links might also point to other radio broadcast 
frequencies to which the radio transceiver is automatically 
tuned after the selecting the corresponding link. These 
transmissions, for example, provide expanded information 
on the topic carried in the initial broadcast, or offers a more 

1 elaborate list of choices. 

It will be appreciated that the concepts described herein 
may be usefully applied to other forms of media. 

For video information, directory pages might consist of 
cyclical streams of "trailers" (i.e., short clips from programs 

15 used to entice a viewer to view the entire program). The user 
stops the directory stream using the STOP command, and a 
dynamic menu window is created. The menu window dis- 
plays five (for example) video still frames, one from each of 
the five trailers shown immediately prior to the use of the 

20 STOP command. The user then chooses one of the programs 
by inputting ONE, TWO, . . . , FIVE. Preferably, each trailer 
shown in the initial directory page would be overviews of a 
common topic, such as "Music". Thus, having selected on 
the initial trailers, the user sees another cyclical stream of 

25 trailers related to the common topic of the initial trailer. 
Once the right video page is found, the user receives the 
page as a video program. The page also includes hypervideo 
links that each point to a different video page. As with the 
Audio Web, the user stops the video playback at any time 

30 during the program and builds the dynamic menu window of 
the last, for example, five hypervideo links identified in the 
program up to that point. Selecting one of the hypervideo 
links from the menu causes the client to download the 
corresponding video program from a server and start playing 

35 it. 

Video pages according to the present invention are for- 
matted in a manner similar to audio pages, with hypervideo 
links having the format <i: t/, I*, address>, where t/* f t/ 
represent the beginning and end, respectively, of the frame 

40 that serves as the hypervideo link name. 

Preferably, the client for this format is implemented with 
an interactive television unit, with a remote control unit with 
appropriate push-button inputs for the above-described com- 
mands. Advantageously, the data bandwidth needed to send 

45 commands uplink (to a proxy client running the software) is 
minimal. 

Text information is also managed according to the present 
invention. For example, a ticker-type display of text can be 
used to show a cycling directory page. As before, the user 

50 stops the display at a desired location, builds a dynamic 
menu window, and selects an item of interest. When the 
desired text page is reached, it is displayed in a limited state, 
or elsewhere, if an extra real state is available. 

Hypertext links are encoded in a manner similar to 

55 hyperaudio and hypervideo links, using tuples in the form<i: 
b, e, address>. The only difference is that b and e represent 
the displacement relative to the beginning of the text stream 
in bytes, instead of elapsed time. 

Using TextWeb, a user uses a hand-held computer unit 

60 (sometimes known as Personal Digital Assistants, or PDAs) 
as the client. A PDA typically has limited computing ability 
and a small visual display. Nonetheless, the user can satis- 
factorily uses a PDA to display directory pages, dynamic 
menu windows, and text pages. Moreover, the user may 

65 request full text pages to be sent to other devices where they 
can be more easily read, such as a fax machine in a 
fax-on-demand mode. 
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Finally, a multimedia web is implemented by combining 
audio, video, and text into displays. In this case, all three 
media would be first class objects. At each stage of the web 
concept, the user receives multimedia information in accor- 
dance with the concepts describe above, relative to audio, 
video, and text. 

It will be appreciated that this invention encompasses new 
browsers and navigators for the WWW as well. In particular, 
cyclical directories may be incorporated into the currently 
known methods of WWW navigation. 

What is claimed is: 

1. A wide area information system comprising: 

at least one server having at least one audio page, each of 
said at least one audio page having audio data and 
linked by cross-reference to at least one other audio 
page, and means for recognizing sound commands; and 

a client communicating with said at least one server so 
that said audio data can be selectively transferred to 
said client without text or a visual interface upon said 
at least one server receiving said sound commands. 

2. The system in accordance with claim 1 wherein said at 
least one server includes more than one audio page arranged 
in a stacked hierarchy. 

3. The system in accordance with claim 2, wherein said 
stacked hierarchy includes a home page at a topmost level, 
said home page having the first audio data selectively 
transferred to said client. 

4. The system in accordance with claim 3, wherein said 
home page is a directory page having audio data correspond- 
ing to a repeating audio track. 

5. The system in accordance with claim 4, wherein said 
repeating audio track includes a plurality of cross references 
to audio pages in a level of said hierarchy below said home 
page. 

6. The system in accordance with claim 5, wherein said 
hierarchy includes a bottom-most level containing at least 
one page with at least one cross reference link to at least one 
other page. 

7. The system in accordance with claim 6, wherein said 
hierarchy includes at least one intermediate level above said 
bottom-most level, said at least one intermediate level 
having at least one page with at least one cross reference link 
to a page in a level of said hierarchy above said one 
intermediate level, and at least one cross reference to page 
in a level below said at least one intermediate level. 

8. The system in accordance with claim 7, wherein said 
client includes means for controlling the transfer of said 
audio data from said at least one server and for making 
audible said audio data transferred from said at least one 
server. 

9. The system in accordance with claim 8, wherein said 
means for controlling the transfer of said audio data includes 
means for inputting commands for controlling said repeating 
audio track of said directory. 

10. The system in accordance with claim 9, wherein said 
means for inputting commands includes means for inputting 
a command to stop playback of said repeating audio track. 

11. The system in accordance with claim 10, wherein said 
client includes means for identifying a subset of said plu- 
rality of cross references in said repeating audio track 
immediately prior to receiving said command to stop play- 
back of said repeating audio track. 

12. The system in accordance with claim 11, wherein said 
client includes means for selecting one of said cross refer- 
ences in said subset. 

13. The system in accordance with claim 12, wherein said 
means for identifying a subset of said plurality of cross 
references generates an audible list of said cross references 
in said subset. 
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14. The system in accordance with claim 13, wherein said 
cross references in said subset correspond to a set of cardinal 
numbers, wherein said means for inputting commands for 
controlling said repeating audio track include means for 

s inputting a cardinal number for selecting one of said cross 
references in said subset whereby a page corresponding to 
said selected cross reference is transferred to said client via 
said audio data transfer connection. 

15. The system in accordance with claim 14 wherein said 
J0 means for inputting commands includes means for inputting 

a resume playback command of said audio track. 

16. The system in accordance with claim 15 wherein said 
means for inputting commands includes means for inputting 
search commands whereby said repeating audio track can be 
searched to find a desired cross reference. 

15 17. The system in accordance with claim 16 wherein said 
search commands include a forward command for advanc- 
ing playback of said repeating audio track, relative to a given 
instant, by an interval of time, and a back command for 
receding playback of said repeating audio track, relative to 

20 given instant, by an interval time, 

18. The system in accordance with claim 17 wherein said 
intervals of time by which playback of said repeating audio 
track is advanced or receded are variable in accordance with 
a binary search algorithm. 

25 19. The system in accordance with claim 18 wherein said 
intervals of time by which playback is advanced or receded 
progressively decrease in correspondence to repeated inputs 
of said forward and back commands. 

20. The system in accordance with claim 1, wherein said 
30 client further comprises means for making said audio data 

transferred to said client audible. 

21. The system in accordance with claim 20, wherein said 
client comprises means for inputting a plurality of cardinal 
numbers and at least one command action. 

35 22. The system in accordance with claim 21 wherein said 
means for inputting a plurality of cardinal numbers and at 
least one command action comprises a keypad having 
respective keys or combination of keys that are mapped to 
respective ones of said plurality of cardinal numbers and to 

40 said at least one command action. 

23. The system is accordance with claim 22 wherein said 
client comprises a telephone having said keypad and an 
earpiece, and wherein said one at least one server is provided 
with means for recognizing tones generated by said tele- 

45 phone when said keys or combination of keys are pressed 
and wherein said means for making said audio data audible 
includes means for making said audio data audible in said 
earpiece. 

24. The system in accordance with claim 22, wherein said 
50 client comprises a computer having a sound generation 

device and a keyboard, wherein said keyboard comprises the 
cardinal number input and at least one command action 
means, and wherein said means for making sound data 
audible includes means for making said audio data audible 
55 in said sound generation device. 

25. The system in accordance with claim 21, wherein said 
means for inputting a plurality of cardinal numbers and at 
least one command action comprises means for recognizing 
spoken words corresponding to said plurality of cardinal 

60 numbers and at least one command action. 

26. The system in accordance with claim 15, wherein said 
client comprises a telephone having a mouthpiece and an 
earpiece, and wherein said spoken words are received 
through said mouthpiece and said at least one server is 

65 provided with means for recognizing said spoken words and 
wherein said means for making said audio data audible 
includes said earpiece. 
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27. The system in accordance with claim 1, wherein said 36. The method in accordance with claim 35 wherein said 
client includes means for identifying one of said at least one presenting step further includes the step of converting said 
audio page with a user-created cross-referencing bookmark transferred audio data into audible sound. 

whereby said page is directly selectable for transfer from 3? ^ method jQ accordance with claim 36 wherein said 

said at least one server to said client by selecting said c _ , . 

bookmark ste P providing a selection menu comprises: 

28. The system in accordance with claim 27, wherein said presenting a first set of said plurality of choices in a 
client includes means for storing a plurality of said user- sequence; v 

created bookmarks. . . . , . c a . . c , Vi e 

29. The system in accordance with claim 28, wherein said sto PP ,n S sald P«sentat,on of said first set of plurality of 

client further includes means for deleting said bookmark. choices; and 

30. The system in accordance with claim 29 wherein said presenting a second set of choices from among said first 
means for storing a plurality of bookmarks includes means set of a choices whereby said second set makes up said 
for accumulating a list of bookmarks organized as a direc- selection menu. 

torv P?§ e ' . , - e 38. A system for presenting audio information to a user 

31. The system m accordance with claim 1, wherein said J3 comprising- 
client includes a memory cache having the capacity to hold p 8 * 

at least one of said at least one audio page while a current at least one server having one or more audio pages stored 

audio page is being played by said client. thereon, said audio pages having audio data and linked 

32. The system in accordance with claim 31, wherein said by cross-reference to at least one said other audio page, 
client includes means for moving between said current audio 20 and means for recognizing sound commands; and 
page and said audio page held in said memory cache. a dicnt hav{ means fof selectively reqU csting and 

33. In a wide area information system having at least one . . - f 

, . . * i : j- u receiving one of said audio pages from said server, 

server, each server having at least one audio page having ^ b . , r . f , . _ n , 

audio data and means for recognizing sound commands, and 39 * Th«ystem in accordance with claim 38 wherein said 

a client, and wherein information is stored entirely in the 25 clieDt further comprises: 

form of the audio page and the system is navigated without means for presenting said audio data received in said 

the use of text or a visual display, a method for presenting audio pages to the user; and 

the audio data to a user comprising the steps of: means for recognizing a plurality of inputs and a set of 

establishing a connection from the client to the server; commands received from said user, 

sending a sound request message having an identifier 30 40. The system in accordance with claim 39 wherein said 

from the client to the server for one of said at least one present means comprises means for making said audio data 

audio page; received in said audio pages audible, 

receiving at the client said requested audio page having 41, The system in accordance with claim 40 wherein said 

audio data identified by said message request from the means for recognizing a plurality of inputs and a set of 

server; 35 commands comprises means for mapping each of or a 

ending said connection; and combination of a plurality of cardinal numbers to respective 

presenting, at the client, said received audio page to the ones 0 f sa i d inputs and to said set of commands. 

user. 42. The system in accordance with claim 41 wherein said 

34. The method in accordance with claim 33 wherein said at least one inc i udes more tnan one ail dio page anc j 

step of receiving further comprises the substep of transmit- w h ere in said one or more audio pages are arranged in a 

ting from the server said audio page identified by said gtacked hierarchy having a home page at the uppermos t 

message request, and wherein said audio page includes a ^ afl audio web at ^ bottom . most level and at 

paeetype identifier for indicating that said audio page is a « . . ,. . , , . . . , , * 1 1 

Jr , . , b . * . least one intermediate level above said bottom -most level, 

directory page having a repeating audio track or an audio . 4 , t ■ * ^.i 1 1_ • * 1 

. * . j- 4 1 j v j* 1- 1 45 said at least one intermediate level having at least one page 

web page having a linear audio track and hyperaudio links . , - t . . & .11* 

after said audio tracks, said hyperaudio links having a link ™%*} Ieas J; one L cross ^ ference ^ *? a **& m \ ltv f of 

number, a pair of elapsed times, and an address to which said said hierarchy above said one intermediate level, and at least 

hyperaudio links points. one cross reference to page in a level below said at least one 

35. The method in accordance with claim 34 wherein said intermediate level. 

presenting step further includes the steps of: 50 43- The system in accordance with claim 42 wherein said 

providing, at the client, a selection menu having a plu- means for inputting commands includes means for inputting 

rality of choices to the user, each of said plurality of search commands whereby said repeating audio track can be 

choices corresponding to a portion of said received searched to find a desired cross reference. 

audio data; 44. The system in accordance with claim 40 wherein said 

selecting, at the client, one of said plurality of choices 55 means for receiving one of said audio pages comprises 

corresponding to a portion of said received audio data means for receiving radio transmission broadcasts having 

from said selection menu; and said audio pages, wherein each said cross-reference points to 

transferring said portion of said received audio data from one of said at least one server, and wherein said client 

the client to the server such that said audio data 60 comprises a radio transceiver. 

corresponding to said selected one is received at the 

client. ***** 
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ABSTRACT 



A player interactive live action football game which may be 
played for example on a television screen. A player inter- 
active live action football game is provided which comprises 
a random access storage and retrieval device and a plurality 
of individual, pre-recorded action football plays illustrating 
interaction of players of opposite teams. This information is 
stored in random access storage and retrieval device and 
accessible according to type of play. The invention further 
comprises a microprocessor and microprocessor control 
device electronically associated with the random access 
storage and retrieval device. The microprocessor is pro- 
grammed to enable one or more users to select in sequence, 
through the control device, different football plays according 
to play type. A display device is electronically associated 
with the microprocessor to enable the selected plays to be 
viewed by the users. The microprocessor is further pro- 
grammed to evaluate and cumulate play results and report 
them to the users in a meaningful way. 

14 Claims, 5 Drawing Sheets 




12/22/2003, EAST Version: 1.4.1 



y 

U.S. Patent Dec 9, 1997 Sheet 1 of 5 5,695,401 




FIG. I 



12/22/2003, EAST Version: 1.4.1 



U.S. Patent 



Dec. 9, 1997 Sheet 2 of 5 5,695,401 




CM 

■ 



12/22/2003, EAST Version: 



1.4.1 



U.S. Patent 



Dec 9, 1997 



Sheet 3 of 5 



5,695,401 



CO 
CO 




o 

CO 



3 



< ^ 



to S 
o ° 



CO 

> 5 
o 



CV1 




CO 



o 

CD 
O 



UJ 

O 



I- o r; 

ass 



gig 

5og 



CD 
C\J 



£ cr Q 

ill 
to o 





CD 

o 



o 

o 
o 



occ. . , . 

Q 
O 

s 



~3 



o o ^ 
3 > < 



CO 

















o ° ° t±! 

uJ O OC E 




OZOUI 




VI 

witchi 

NALOG 
•WIPE 






CO < 



CO 

■ 

EE 



CD 



CO 



CD 



CO 

in 



- GAME 
STATISTICS 

AND 
CONTROL 




PLAYER 

DATABASE 




CALCULATE 

- RESULT 

— OF PLAY 







3 y 



12/22/2003, EAST Version: 1.4.1 



U.S. Patent Dec 9, 1997 Sheet 4 of 5 5,695, 



PLAY 
SEQUENCE 




REPLAY 
SEQUENCE 



FRAME 1 
FRAME 2 
FRAME 3 
FRAME 4 

ACTUAL PLAY 

FRAME 5 

FRAME 6 
FRAME 7 

FRAME 8 



FRAME 9 
FRAME 10 



FRAME11 

FRAME 12 
FRAME 13 
FRAME 14 



FRAME15 
FRAME 16 
FRAME 17 

mm 



FIG .4 



12/22/2003, EAST Version: 1.4.1 



U.S. Patent Dec % mi sheet s of 5 5,695,401 



to 

o 
F 

cc 
I— 

CO 



LU 

,2 

<: 



cc 

F" 

< 

ZD 

o 



LU 



X 



cc 
< 

a 

-d 



LU 



LU 

s 
< 

CO 

o 

LU 

CC 



LU 

< 

CO 



LU 

—J 
CO 



< 
CD 




12/22/2003, EAST Version: 1.4.1 



5,6< 

1 

PLAYER INTERACTIVE LIVE ACTION 
ATHLETIC CONTEST 

The present application is a continuation-in-part of appli- 
cation Ser. No. 07/811,226 filed Dec, 20, 1991, now U.S. 
Pat No. 5,462,275. 

FIELD OF THE INVENTION 

The present invention relates to a player interactive live 
action athletic contest such as a football game which may be 
played for example on a television screen. 

BACKGROUND OF THE INVENTION 

Video games featuring sports including football are wen 
known. Such video games generally incorporate computer 
generated graphics stored in a memory and accessed by a 
computer. Examples of such computer graphics video games 
are described and illustrated in Canadian Patent No. 1,221, 
761 issued May 12, 1987 of Hueda ct al, Canadian Patent 
No. 1,236,217 issued May 3, 1988 of Bromley et al and 
Canadian Patent No. 1,232,093 issued Jan. 26, 1988 of 
Tatsumi et al. 

U.S. Pat. No. 4,766,541 issued Aug. 23, 1988 of Bleich et 
al describes and illustrates a video game or the like which 
includes a real time interactive video disc game-play back- 
ground generation system. The discs contain video data 
which is under the control of the game processor, whereby 
the sequence of frames to be played can be varied on a frame 
by frame basis. 

Other references of general background interest teaching 
electronic simulated sports games include U.S. Pat No. 
4,662,635, Enokian issued May, 1984; U.S. Pat No. 4,304, 
404, Pundt issued December, 1981; U.S. Pat No. 4,799,677, 
firederikson issued January 1989; U.S. Pat No. 5,026,058 
issued June, 1991 and U.S. Pat No. 5,067,079, Smith et al 
issued November, 1991. Of particular interest, U.S. Pat No. 
4,662,635 of Enokian teaches that video images of players 
engaged in a series of athletic plays be displayed on a 
television screen while the field position is calculated and 
displayed on a separate, lighted panel representing a football 
field. 

SUMMARY OF THE INVENTION 

In accordance with the present invention a pre-recorded, 
live action and sound, full motion video, interactive athletic 
contest which comprises players of opposite teams playing 
at various positions on a background field. The game com- 
prises a random access storage and retrieval means, the 
random access storage and retrieval means for storing a 
plurality of individual, pre-recorded video images represen- 
tative of live action plays of the athletic contest illustrating 
interaction of players of the opposite teams. The game 
further comprises a microprocessor and microprocessor con- 
trol means electronically associated with said random access 
storage and retrieval means for enabling one or more users 
to select in sequence through said control means different 
ones of said plays according to play type, the microprocessor 
then, by using statistical tables, to select the video image of 
the actual play according to play type selected by the user. 
A display means is electronically associated with said micro- 
processor enabling the selected plays to be viewed by the 
users. Hie microprocessor is further programmed to evalu- 
ate and accumulate play results and report them to the users 
in a meaningful way. 

Preferably the live action football plays are recorded on a 
football field complete with all markings normally found in 
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an American style football game, with a limited number of 
field positions from which the ball can be scrimmaged so 
that all plays originate and complete on one of a limited 
number of pre-s elected lines of scrimmage. 

5 Hie football game according to the present invention may 
stare the video material using laser disc technology 
CD-ROM, computer hard drive or other storage means 
allowing random access retrieval, and may also store audio 
material for real-time playback of voice, music and sound 

10 effects. The game as played appears to the viewers to be a 
real television broadcast of a live game, the content of which 
is dictated by selections of plays by the users. 

The game according to the present invention is unique in 
that it permits the viewer to interact with what appears to be 
an actual televised professional American style football 
game. 

In order to make this game appear to be an actual televised 
football game, several unique design features are used. First, 
there are no prompts or messages to the game players 
appearing on the television screen since these or any other 

20 "computer game" type of instructions would not appear in a 
real television broadcast All game instructions and player 
prompts are issued through the individual game controllers 
controlled by the game players. These game controllers 
feature a display means to prompt players with game status 

25 messages and request input response to effect proper game 
play. The television screen only displays what would nor- 
mally be seen in a real televised game. 

Secondly, the video display sequences (e.g. opening, 
closing, football plays, commercials, status screens etc.) are 

30 in 'Video'* terms, each video sequence is edited in real time 
to the previous video sequence with a simple "cut" edit or 
. with a "dissolve" or "wipe" video transition effect. The end 
visual result is a continuous video/audio display without any 
pauses, gaps or break in the video/audio display. The dis- 

35 solve or wipe transitions require the extensive generic 
mapping of each video sequence as described later in this 
document and illustrated in FIG. 4 so that two video 
sequences may be properly controlled and timed so that the 
end of the previous video sequence overlaps the start of the 

40 next video sequence so that the wipe or dissolve can be 
properly displayed. This technique is known in the video 
production industry as an "A/B Roll Edit". 

Thirdly, not apparent in the display means, but necessary 
to produce the above described video transitions, the com- 

45 putcr software and the hardware video display drivers 
(whether they be for NTSC video playback of laser video 
disc or video decompression and playback of digital video 
from hard drive or CD-ROM or the like) must be capable of 
controlling two video display devices simultaneously in real 

so time so that the A/B rolls overlap. 

lit is an object of the present invention to provide an 
interactive, live action football game that can be played by 
one or more persons in a home, bar or the like. It is a further 
object of the present invention to provide such a television 

55 game which permits the players to select full motion video 
images, as opposed to computer generated graphics, to play 
such game and determine the outcome. 

BRIEF DESCRIPTION OF THE DRAWINGS 

go These and other objects and advantages of the invention 
will become apparent upon reading the following detailed 
description and upon referring to the drawings in which: 

FIG. 1 is a schematic view of the game components of the 
game in accordance with the present invention; 

65 FIG. 2 is a schematic block diagram showing the com- 
ponent layout of the game according to the present inven- 
tion; 
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FIG. 3 is a software block diagram of the game of the 
invention; 

FIG. 4 is a schematic diagram of a video play sequence 
breakdown for the game in accordance with the present 
invention; 

FIG. 5 is a video sequence flow chart showing the various 
video pathways required in accordance with the invention to 
link the video sequences together to create a continuous, 
realtime game. 

While the invention will be described in conjunction with 
an example embodiment, it will be understood that it is not 
intended to limit the invention to such embodiment On the 
contrary, it is intended to cover all alternatives, modifica- 
tions and equivalents as may be included within the spirit 
and scope of the invention as defined by the appended 
claims. 

DETAILED DESCRIPTION OF THE 
INVENTION 

In the drawings, similar features have been given similar 
reference numerals. 

FIG. 1 illustrates schematically the various hardware 
components of the football game system in accordance with 
the present invention. A random access storage and retrieval 
means 2, preferably a laser disc storage device 1 is elec- 
tronically associated with a microprocessor 4, control mod- 
ules 6 and T.V. monitor 8 as illustrated. Laser video disc 
storage device 2 preferably additionally provides for storage 
and retrieval of audio information on audio channels. 
Alternatively, audio information may be stored on a 
separate, audio storage means (not illustrated) with audio 
information being correlated to video information by means 
of microprocessor 4. 

In more functional terms, the main components of the 
game system according to the present invention are illus- 
trated in FIG. 2. These components may be defined as eight 
basic components: 

1) input devices 6 

2) central processing unit 4 

3) modem 10 

4) video storage/retrieval means 12 

5) audio storage/retrieval means 14 

6) video/audio routing means 56, 57 

7) T.V. monitor 8, audio amplifier and speakers 

8) graphics character generation means 22 
With the exception of the TV, monitor and two game pad 
control modules 6, all of these components may be physi- 
cally contained in a single enclosure or cabinet. 

The input devices include the two game pad control 
modules 6 and a signal receiver (not illustrated) in main 
computer unit (CPU) 4. Game pad control modules 6 
communicate to the signal receiver using either infrared 
pulses, ultrasonic audio waves or low powered radio waves 
with a pulse code modulated security code. The game pad 
control modules 6 preferably have five input buttons mat 
control all game functions. Each input command on the 
game pad control module will be accompanied with an 
appropriate prompt on the game pad control module's LED 
or fluorescent LCD display. The display information is 
broken into four main sections: 

1) prompt display 

2) timer display 

3) status display 

4) input display 
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The prompt display is the main display 21, located near 
the top of the game pad controller, that will prompt the 
player for the next input or tell them to wait or display other 
such information. The display will flash a message soon as 
5 either the word <SELECT> or the word <WAIT>. To the 
right of this flashing prompt, on the same prompt display 
line, there will be a 20 character display that will indicate the 
type of selection required (Le. Type of Play) ox explain the 
wait condition (ie. Time Out Called). 

]Q Preferably in the upper right corner of the game pad 
controller, there is a two digit numeric display 22 with large 
sized characters. This numeric display is the Clock Timer 
display and will indicate the amount of time left to enter a 
decision once a prompt has been issued. The preferred 

15 standard countdown during a play sequence will be from 15 
or 20 seconds backward to zero. If an offensive call has not 
been made by that time, a Delay of Game Video Sequence 
will be played giving extra time to the offense to enter a 
decision. If no decision is entered by the end of the Delay of 

20 Game Video Sequence the game will be terminated and 
awarded to the other team. 

In addition to the <SELECT> input prompt and the 
numeric Countdown Timer display, there is also a 14 char- 
acter alphanumeric display 23 beside each of the 5 input 

25 buttons. These displays will identify the input command for 
each button. For example, if the prompt requests 
"<SELECT> TVpe of Hay", then to the right of each of the 
5 inputs burtons will be a display showing the type of play 
that button will select 

30 Example: 



<SELBCI> Type of Play 

Rim 
Pas* 

35 Kick: 

Time Out 
Quit 



If •■Run" is selected then the Prompt Display and the five 
40 Input Displays will change to read: 



<SELECT> Type of Run 

Run Left 
Up the middle 

45 Run right 

Time out 
Quit 



It is not intended in this description to place an upper or 
50 lower limit on the number of types of play that can be 
selected and displayed on this screen. Since there are five 
input selection buttons described here there may be as many 
as five types of play used in the final release version of this 
game or on later upgrades and versions. If five types of play 
55 are offered then they would preferably be: 
Wide left 
Dive right 
Up the middle 
Dive right 
60 Wide right 

There may also be as few as only two type of play offered, 
for RUN plays the display would preferably read: 
Left 
Right 
65 (blank) 
lime Out 
Quit 
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For Pass plays there would preferably be (but not limited to) 
one of the following variations: 



Left Left Deep Left 

Right Center Short Left 

(blank) Right Up the middle 

Time out Time out Short Right 

Quh Quit Deep Right 



It is not the intent in this description to limit the description 
of each play to only those used in these examples. 

The selected response is then received by CPU 4 and 
processed along with other game factors, as will be 
described in more detail hereinafter, to determine which 
video play sequence or other video sequence (such as Time 
Out, etc.) will be used next It will then communicate with 
the other components in the system to set up the next video 
sequence. 

CPU 4 also locates where all video and audio elements are 
stored in video storage and retrieval means 12 and audio 
storage and retrieval means 14. Then commands are issued 
to the proper device controllers to cue up the first video and 
audio elements needed to start the sequence. 

Video storage and retrieval means 2 can be any video 
storage system that has sufficient storage capacity for the 
required program, providing it is capable of random access, 
within the limited rime frame of the parameters of the game, 
to all video and audio sequences stored in this medium. 
Suitable storage mediums that meet these requirements 
include laser video disc, CD-ROM compact disc and RAM 
hard drive. (Video stored in a digital format will probably 
use compression techniques such as Inters "DVI System" 
(Trade-mark)). As new storage mediums are developed any 
medium meeting the storage and random access require- 
ments of the present invention can be used. 

The video images stored in this medium will be full 
motion video (Le. thirty video frames per second). These 
images can be stored in analog form as on a Laser Video 
Disk (CAV or CLV formats), or as compressed digital data 
(CD-ROM) using video compression techniques. The reso- 
lution of the image may vary depending on the type of 
system used but in all cases the final video output will match 
the video system used in the country or region of use. In 
North America for example, the video output will be NTSC 
Standard. In Europe it will be a PAL/Secam dual format A 
Standards Conversion Unit can be installed down stream 
from the system so that all images are stored and controlled 
in NTSC format with the final video output going through 
the Standards Conversion Unit converting it to PAL/Secam. 
The other alternative is to store and display the video data 
entirely in the local broadcast format used and, since the 
video frame rate for PAL/SECAM is 25 video frames per 
second, this would require rewriting the control program and 
data base to work with a video frame rate in base 25 rather 
than base 30. 

The audio storage and retrieval means 14 can utilize 
several different formats. More than one of these formats 
may be utilized in the final design. The major storage format 
will be in accordance with the final video format used. If, far 
example, the final video format is Laser Video Disk, then 
most of the audio will be stored on the existing audio tracks 
used on Laser Video Disk. This format will permit the use 
of two audio tracks that share common frame numbers with 
the video portion. In other words, for each addressable video 
frame on the Laser Video Disk as there are two correspond- 
ing audio frames with the same address. Additional audio 
tracks can be located on other Laser Video Disks run in sync 
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with the main video sequence. Another possible source is a 
CD-Audio Company (Trade-mark) Disk running in sync 
with the video using a similar frame code addressing system. 
Digitized sound can also be stored on hard disk drive for 

5 extremely fast random access. Regardless of the storage 
format used, the audio storage requirements are the same as 
the video storage requirements in that they must have large 
capacity and random access capability within the limited 
time frame parameters of the game. 

The graphic character generation means . 22 generates 
graphics such as game statistics and players names for the 
video inserts and stats boards. This generator is required to 
generate characters and simple lines for underlining titles. It 
must generate several sizes of font in different colours. 
In analog format all graphics are routed to the video/audio 

15 switchers) and graphics keying device 18 for insertion into 
the video picture. In digital format the graphic will prefer- 
ably be inserted downstream from the video/audio switching 
device(s). The video/audio switchers) 18 can be either 
analog or digital. In analog form the device would be a 

20 standard video/audio switcher controlled by the main CPU 
through a General Periphery Interface (GPI). The video 
switcher would generate the wipe effects that link the video 
sequences together and it would include a graphics keying 
device. The graphics keying device enables the system to 

25 insert graphics over the entire picture (i.e. score inserts, 
statistics, players names etc.). In digital format the character 
generator would contain circuitry to insert or overlay graph- 
ics downstream from the video/audio switching device(s). 
In analog format the video switcher also manages audio 

30 routing of the final mixed audio. In digital format the audio 
will be routed separately from the video picture and taken 
directly from the A-RoU/B-Roll audio cards (or audio out- 
puts on the video decompression cards if available) to an 
audio switcher device. 

35 There are a number of low cost analog switching devices 
available on the market In the digital domain, video and 
. audio switching as well as graphics keying can be handled 
with a number of "off the shelf 1 VGA to video adaptor cards 
currently available far the IBM platform. Many of these 

40 cards allow the use of wipes and keys in their basic format 
as well as a number of other Digital Video Effects (DVE) 
that can be incorporated into the production design of the 
program. Providing they support simultaneous video input 
and display from two pre-recorded video sources. 

45 The modem 10 will operate under control of the CPU 4. 
During play it may feed control program information 
through to other game systems at other locations. When the 
system is not being used it will periodically report back to 
a central service center and database (not illustrated) sup- 

50 plying current information on usage for marketing analysis 
as well as reporting back to the service center for any trouble 
or equipment failure. 

The software operating CPU 4 will be described now in 
more detail, having reference to the software block diagram 

55 of FIG. 3. The two game pad controller modules 6 are used 
to display information and options to the players and send 
the choices back to the computer via send/receive choices 
from game controllers 26. 
The game logic 28 uses data from the send/receive 

60 choices from game pad controllers 26 to choose the next 
video sequence and to send information back to or request 
input from the game pad controller modules 6. 

The offensive database 30 contains the information to 
rank the basic effectiveness of an offensive call. 

65 Hie defensive database 32 contains the information to 
rank the effectiveness of each defence called versus the 
offense called. 
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The video database 34 contains information on every Frame Position 2 marks the end of the 1 second video 
video sequence stored in random access storage of video/ transition and the end of the previous video sequence, 

audio 35. The timing information for each video sequence is The first optional audio window begins at Frame Position 

also located here and accessed by the video control logic 36. 3 and ends at Frame Position 4. This audio window is a 2.5 

The commercial logic or advertisement logic 37 works 5 second portion of the existing sync dialogue of the Play By 

with the game control logic 38 to determine when and where pj ay announcer that can be deleted without breaking conti- 

commercials should be played. nuity m me flow cf me analogue and replace with a voice 

The commercial or advertisement database 39 contains infieit by me same announcer giving yardage and field 

information on every commercial in random access storage position updates 

and keeps a record of how many times and when each one tn . . VT *i c ^ ^ , Jt . j 

. , \ J 10 An important feature of the first optional audio window is 

15 The adjust local game control function of game control ™™\ B J* 0 ™*? ball ^ brought into play, 

logic 38 will pass on information about the current video . ^ start of me actual football play (i.e. snap of the ball), 

sequence to calculate the result of play at 42. The adjust * s not recorded with a frame position number since it is not 

local game control 38 also manages the logic for the riming important in me timing of the video play sequence, 

and control of all video and audio sequences as well as the 13 "H* 6 cn< * position of the actual play is important however 

control program for the modem link. since occurs when the referee blows his whistle and the 

The player database 44 contains the profile information on ball is taken out of play. The point at which the whistle is 

every player in the game. It is updated every time a result of blown is designated as Frame Position 5. During normal 

play calculation is made. game play the game clock will continue to run throughout 

The results of play calculations are also passed on to game 20 the entire video play sequence except in the last two minutes 

statistics and control 46 which provides information on of the first half and me last two minutes of the game. During 

score, momentum, player and team performance and game these two 2 minute periods the game clock will stop at 

control variables. Frame Position 5 in every video play sequence and restart at 

The video/audio inserts database 50 stores information on Frame Position 1 in the next video play sequence, 

all inserts that are available to the video control logic. 25 Framc Position 6 and Frame Position 7 mark the location 

The show video sequence 53 controls the driving of video of me ^ ^ oat of another optional audio window, 

and audio devices such as laser video disks , CD-Rom etc This window occurs after the ball has been taken out of play 

The random access storage of video/audio 35 contains all and a ncw fieM ition ^ down ^ establisnedt 

video and audio material. The number and types of devices ^ ^ m £ , _ ffi opportunity to say 

may be intermixed and include such devices as laser video „ rt . Iu .t 1 V T I 

disk, CD compact audio disc, CD-Rom, computer hard drive 30 * her < !°" , has e »** u £ ™ d w^t the downage situation 

and any otherrandom access storage devices! is so ttat the players in the bar can be informedfor their next 

The analog or digital video switching device 56 and audio play decision. 

switching device 57 are controlled by the video game NOTE: wm ^° 1x5 ^ rcadouts of 7 anla 6 c ««* 

control logic 38 and switches between all video and audio downs on each player's game pad display. These readouts 

signals. In analog format this device also contains a graphics 35 be dedicated to this specific function and visible to the 

keying device for keying in the graphics from the graphics players at all times during normal play of the game. (See 

character generator 22. In digital format the graphics keying Section 19 — Main Component Layout) 

will be downstream from the video switching device 56 and Both audio windows at Frame Positions 3 and 4 and 

controlled by the video game control logic. Frame Positions 6 and 7 as well as a third audio window to 

An important aspect of the game according to the present AO be described lata at Frame Positions 14 and 15 are optional 

invention is the play sequence as illustrated in FIG. 4. This audio windows that will not be automatically used every 

frame mapping, applied to all video sequences used in the time they occur. These audio windows will be used at 

game, gives the game software a standardized set of cueing random intervals to vary the structure of the video play 

and tirning points to be used to facilitate the simultaneous sequence format. The amount of randomizing will be deter- 

and synchronized play of any two video sequences in order 45 mined in Alpha/Beta testing of the prototype game and will 

to perform a continuous series of seamless "A/B roll" video probably favour the second audio window since it occurs 

edits throughout the game. To illustrate this FIG. 4 repre- after the current play has been completed, therefore the 

scnts the video play sequence which is the basic video unit updated information in the second optional audio window 

of a Sports Active Television Football Game. (Frame Positions 6 and 7) is more useful to the bar players 

The video play sequence consists of two main parts: 50 since they must now make their next play decision. 

1) REALTIME PLAY However, since it is intended to use all three optional 

2) SLOW MOTION REPLAY audio windows to vary the format of the video play 
In particular, the illustrated frame positions represent the sequence, there may be occasions when more than one 

following: window is used in the same play. If more than one audio 

Frame Position 1 starts the video play sequence and 55 window is used during a video play sequence then it should 

marked the beginning of a 1 second wipe or dissolve video be a combination of the first optional audio window (Frame 

transition from the previous video sequence. This is also the Positions 3 and 4) plus one of the other two windows that 

start of the REALTIME PLAY portion of the video play occur after the ball is taken out of play. This would give the 

sequence. current yards and downs before the play and the new yards 

Frame Position 1 also marks the main edit in point for the 60 and downs after the play is completed. This type of audio 

audio track and unlike the 1 second video transition, the insertion has the added benefit of making the Play by Play 

audio is a straight cut take. announcing appear to actually be in real time. 

It is important to keep clear and understand that although Frame Position 8 marks a tuning location backtimed 22 

the main video edit point has already passed and the audio seconds from the end of the video play sequence that will 

has been edited, the previous video sequence continues on 65 trigger the game pads to prompt for the next player input 

until the 1 second wipe effect is finished at Frame Position This position is independent of the start of the slow morion 

2. replay portion of the video play sequence, but will always 
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occur after the ball has been called out of play. The exact Frame Position 13 is the start of the video transition for 

location of Frame Position 6 will be the total number of the optional edit out point, the end of the audio track for the 

seconds before the end of the video play sequence (Frame previous video sequence and the starting position for the 

Position 18) that is needed to give the bar players 20 seconds next video sequence and the edit in point for the audio track 

to make their next play decision inputs, plus 1 second seek 5 of this next sequence. 

time to locate the next video sequence plus 1 second for the Frame Position 14 is the end position for the video 

video transition. transition as well as the end of the video for the previous 

Frame Position 9 marks the start of the video transition video sequence, 

between the Realtime Play portion of the video play Frame Position IS is the location of the start of the third 

sequence and the slow motion replay portion. Frame Posi- 10 and final 2.5 second optional audio window for yardage and 

tion 9 also locates the start of the next video sequence which down inserts. 

would normally be the corresponding slow motion replay of Frame Position 16 is the location of the end of the third 

the previous Realtime Play sequence however the slow and final 2.5 second optional audio window, 

motion replay may be occasionally substituted with a short Frame Position 17 marks the normal input deadline for the 

commercial break or a player or game statistics graphic If 15 players to call the next play when the optional edit out point 

a substitution is made then then video or graphic sequence has not been invoked by a quick play call from the offense, 

used should be of equal average length to the slow motion If no play has been called by the offense, mere will be a short 

replay sequence which will be on average 20 seconds. coinmercial break, if they haven't entered a decision after 

Frame Position 9 also marks the position at which the the break another commercial break will be called and if 

audio for the realtime play portion ends and the audio for the 20 there is still no response after this second break then the 

next sequence is taken up full with a straight, butt cut edit game will be called as described in Section 9. 

Frame Position 10 marks the end of the 1 second video Frame Position 17 will occur 1 second before Frame 

transition between the realtime play and the slow motion Position 18 to allow for seek time for the next video 

replay (or its substitute) portion of the video play sequence. sequence. 

It also marks the end of the realtime play portion of the 25 Frame Position 18 marks the beginning of the 1 second 

video. video transition to the next video sequence. Frame Position 

Frame Position 11 will locate the offense input deadline 18 is also the start position for the next video sequence and 

position for an optional edit out point. If the offense has is the position where the audio for the current video 

entered both play decisions by Frame Position 11 then the sequence ends and is edited to the audio at die beginning of 

video play sequence will end at the optional edit out point at 30 the next video sequence. Frame Position 18 will occur 1 

the end of the video transition at Frame Position 14. If the second before Frame Position 19. 

optional edit out point is used then the audio for the slow Frame Position 19 marks the end of the 1 second video 

motion replay will end at the beginning of the video tran- transition and the end of the video footage for the current 

sition at Frame Position 13. video play sequence. 

If the offense has made their input decisions by Frame 35 Where a sequence of plays are to be undertaken, the first 

Position 11 in time to invoke the optional edit point, the step in this sequence will be to cue the main video element, 

defense will be warned that they only have 5 seconds left to such as a video play sequence (selected from laser video 

enter their defense calls. This warning will be visual in the storage retrieval means 12) at a location prior to the desired 

form of a flashing LED display such as the countdown timer video material that will provide sufficient time far lockup or 

on the game pad, or it can be with a dedicated warning light 40 synchronization of the video picture. If for example the 

on the game pad that would light and possibly flash when the video lockup time is one second, the cue position for the 

offense enters a quick play decision. video sequence will be one second or thirty video frames 

Frame Position 12 is the input deadline of the defense to before the edit in point of the cued video sequence. Then 

enter a play decision when the offense has made a quick call when the current play sequence, already in progress, reaches 

and invoked the optional edit out point. If the defense fails 45 a position one second (thirty video frames) before its "edit 

to respond by this time then a default defense call will be outpoint", the next video sequence will start to roll and sync 

entered for them. This default will give them a bad defensive up with the current video sequence, 

call as if they were caught off guard by the offenses quick When the current video sequence reaches its edit out 

play decision and the offense will gain yards on the play. point, the CPU 4 will issue a command to the video 

Frame Position 12 will be located 1 second before Frame 50 switching device to start the video transition (Wipe Effect 

Position 13 to allow for seek time to locate the next video Edit) between the two video sequences. Since both video 

sequence. There will also be 1 second between Frame sequences will now be synchronized together, when the 

Position 13 and Frame Position 14 to allow for the 1 second current play sequence reaches its edit out point, the new play 

video transition. sequence will reach its edit in point at the same time. Once 

The exact location of Frame Positions 11, 12, 13 and 14 55 the edit point is reached, the edit will take place and the 

will always remain 5, 1 and 1 second apart respectively but video transition will begin. 

will vary as a group relative to the video play sequence since The video transition will always have the current play 

each play is different and the optional edit out point must be sequence move off screen (ie. wipe) over top of the next 

at a place where both video and audio can be edited without video sequence when the next video sequence starts in real 

a break in video or audio continuity. 60 time. This is almost always the case but one example of an 

The reason for the optional edit out point at Frame exception would be when we insert a graphic for game 

Position 13 is to give the bar players the ability to speed up statistics. If this insert occurs during live video from the 

the pacing of the game far either enjoyment or strategy, by current play the Insert should wipe in over the current 

entering their play decisions quickly, within the first half of sequence. The video transition cannot exceed the length of 

the time period allowed for entering a normal input 65 the video portions of the video sequence, 

response. This optional edit out point will shorten the video Once the final Frame Position on the current video 

play sequence by approximately 10 seconds. sequence has been reached, that video source will go off-line 



12/22/2003, EAST Version: 1.4.1 



5,695 : 

11 

and the new video sequence will continue as the current 
video sequence. In the meantime, the CPU 4 will be issuing 
similar instructions for the audio inserts that are to be 
inserted into the selected optional audio windows. It will 
determine whether the audio storage device is located and 5 
issue a command to the audio storage device to cue that 
insert an appropriate time ahead of the insert that will allow 
sufficient time for the audio to "lockup" with the video play 
sequence. When this position is reached, just prior to Frame 
Position 2 in the video play sequence, the audio disk will roll 10 
and get up to speed in synchronization with the video play 
sequence so that the starting location for the audio insert will 
correspond with Frame Position 2 (the beginning of the 
target audio window). 

When the "in-point" at Frame Position 2 for the audio 15 
window is reached, the CPU 4 will instruct the video/audio 
switching device to mute the track containing the. Play by 
Play commentary and replace it with the audio insert When 
Frame Position 3 is reached, the mute command will be 
revoked and the original Play by Play commentary will 20 
continue. 

When the video play sequence reaches Frame Position 6 
(FIG. 4), the CPU 4 will send a command back to the game 
controllers requesting the next input from the players for the 
next video sequence. This sequence will then repeat itself 25 
over again. 

As to the question of grid lines, the pre-recorded action 
footage plays display normal field markings of yardage lines 
and numbers, with a limited number of lines of scrimmage 
available to the player, so that the results of each play used 30 
would be compatible with this limited number of lines of 
scrimmage. 

More particularly, the live action football plays are 
recorded on a football field complete with all markings 
normally found in an American style football game. All 35 
plays originate and complete on one of a limited number of 
preselected lines of scrimmage. In a preferred embodiment 
of this variation of the game there is a minimum of 20 lines 
of scrimmage with this number limited only by the video 
storage capacity of each game unit and the attendant pro- 
duction and manufacturing costs. This is not intended to 
place an upper or lower limit on the number of lines of 
scrimmage covered by this invention since this game format 
would work for a lower limit of as few as eight lines of 
scrimmage and an upper limit limited only by the maximum 
number of lines of scrimmage in an American style football 
game. 

Regardless of the number of lines of scrimmage used, 
those lines selected will be the only lines of scrimmage used 
within the game with the exception of certain procedural 
plays such as kickoffs and converts that always originate 
from a specific yard line. The selected lines of scrimmage 
will be the same for both teams and the same but in reverse 
order for both teams when they play in the opposite direc- 
tion. 

The video play sequence is a basic element of the football 
game according to the present invention. It is the actual 
football play itself. The video play sequence will include all 
runs, passes and kicks (including punts, field goals, converts 
and kickoffs, i.e. all football plays stored in video). 

The video play sequence will consist of two main parts, 
the play and the replay. 

The play portion will always be in real time and start prior 
to bringing the ball into play and end after the ball is brought 
out of play with the referee's whistle. If the real time action 
continues with events such as penalties, injuries, rights etc. 
the play portion of the video play sequence will continue 
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until no new action pertinent to the game occurs. Shortly 
after that, the game controllers will prompt their players to 
call their next decisions for the play. 

The replay portion of the video play sequence will always 
start after the ball has been taken out of play and no more 
new action pertinent to the game occurs. The replay portion 
of the play sequence will recap the current play while the 
players are entering their next game decisions. The replay 
will always continue to the end of the video play sequence. 
In this way, the final frame of every video play sequence will 
always be either in slow motion, a freeze frame or a graphics 
insert and thus provide a universal edit point back into the 
real time motion of the beginning of the next video play 
sequence and avoid visual or audible continuity problems 
with the edit The end of the video play sequence will always 
edit to the next video play sequence with a wipe effect so that 
it psychologically brings the viewer back into real time 
without causing time disorientation. 

The video play sequence may be stored on laservideo 
disc, CD-Rom or other storage means in one of the two 
formats. The first format would be to split the play and 
replay portions of the play sequence onto two separate discs 
or storage means. The advantage of splitting the play 
sequence like this is that only one set of play sequences need 
be stored. The play portion of the play sequence would "A/B 
roll" edit to the replay portion stored elsewhere. During the 
playing of either sequence (i.e. play or replay), the program 
can then search the other storage means to locate the next 
sequence to be played. 

The alternate format for storing the play sequences would 
be to store each play sequence intact with both play and 
replay already edited together The advantage of this method 
is that the program needs only locate and edit one complete 
play eliminating the need to search for a separate matching 
replay sequence and editing that to the play portion of the 
play sequence. The disadvantage of this is that in order to 
"A/B rolT any two video sequences using this format, there 
must be a duplicate of each video sequence stored on or in 
a different storage means so that it can be located, cued and 
then played during playback of the current video sequence. 
40 This would double the required video storage space of the 
program. 

When the coin toss sequence is completed and the pro- 
gram returns to the game from the commercial break, the 
first video play sequence, the opening kickoff, will take 
45 place. 

Since the game players have already entered their calls for 
the type of kickoff (i.e. normal or short) during the com- 
mercial break at the end of the previous sequence (coin toss), 
the kickoff play sequence will go ahead without any addi- 
50 tional player input At the end of the kickoff, there will be an 
instant slow motion replay of the highlights of the current 
play while the game players are prompted, through their 
game controllers, to make two decisions. 
First, they win be asked to select the type of play they 
55 want to call, either a run, pass or kick. They will also be 
given two other options at this time, time out and quit 

If the player calls time out and they have not used their 
allowed number of time outs, the game controller will ask if 
the player is sure (Y,N) and then either pause for the 
60 regulation time out period by going to a commercial break 
or, if told No, the game controller will ignore the time out 
request and continue with normal play. 

Similarly, if a player enters a quit response, the game 
controller will ask the player if they are sure and then either 
65 end the game or continue the play, depending on the 
response. If a player does quit, the game is awarded, by 
default, to the other team. 
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If the players did respond correctly to the "select type of 
play" input command, they will be asked to enter the type of 
run, type of pass or type of kick they want to call 

This decision must be entered within a specified time 
limit This time limit might be for example 30 seconds; 
however this may be reduced to as little as IS or 20 seconds. 
Regardless of final time limits imposed on the players' 
decision making process, if the offense does not respond 
with a play decision within the allotted time period then the 
game will go to a delay of game video sequence where the 
announcer will announce that there is some type of holdup 
on the field and that there will be a short break for a 
commercial message while the players get back into their 
huddle. 

Upon returning to the game from this commercial break, 
if a play decision has still not been made by the offense then 
the game will be called for some unusual reason such as 
'lack of interest", 

In the event of a game termination due to lack of a players 
play decision response, the software program will store in 
non-volatile memory all current game data and statistics. In 
the event of a hardware failure (such as a game controller 
malfunction) this feature will allow players to resume the 
game at the same place and in the same situation that existed 
before the termination. 

Termination of a game through a "Quit" response on the 
game controller will not save the current game position and 
situation since this will be a willful call on the part of the 
game players. 

If the defense fails to respond to the same input 
commands, they will be given a default value in the game 
factors so that their chances for a successful blockage of the 
next play will be reduced. In other words, they were either 
too slow in making a defensive call or were caught off guard 
by the offense speeding up the offensive huddle (see below). 

Both game controllers will display a timer that will 
indicate to the players the amount of time remaining before 
they are penalized for a late calL 

The play sequence will also contain an optional edit out 
point at some position in the replay portion of the play 
sequence. There arc several uses for this optional edit out 
point. 

First, they can be used to help break up the repetitious 
sequencing of play/replay in play sequence. Since the cut- 
away sequences are well over 30 seconds in length they can 
be randomly inserted at these positions to cutaway to crowd, 
stadium and player's bench shots. 

Second, they can be used for inserts of updates of game 
statistics or player statistics. During league play, it can also 
be used for inserting league statistics and live updates. 

In both of these examples, the timing of the players input 
responses would not be changed and the offense would not 
give a quick response. 

This "quick response" is the third example of usage of the 
optional edit out point If the offense wants to speed up the 
pace of the game, they can do so by entering their two play 
decisions before Frame Position 5, thereby allowing the 
game control program to end the replay sequence before the 
maximum time allowed, but since it must always be at least 
6 seconds before the actual edit outpoint, for it to make any 
difference to the 15 to 20 second prompt period, it will 
usually be found approximately half-way (or about 7 to 10 
seconds) through the replay portion of the play sequence. 

They will be given an indication of when their call has 
been quick enough to end the replay sequence early 
however, with the same visual cue on the timer display given 
to the defense (see below). 
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The defense on the other hand will be given a warning 
when the offense makes a quick call, the timer on the 
defensive player* s game controller will start flashing and 
adjust to the remaining time left before the next optional edit 

5 out point at Frame Position 5. 

This may seem unfair but remember that the offense 
knows when they have made their inputs and in a real game, 
they would approach the line of scrimmage and therefore 
visually warn the defence to hurry up their call so the 

io defense must be given some kind of warning that the quick 
call has been made. 

An example video sequence flow chart is illustrated in 
HO. 5, showing the various video pathways that may be 
provided to link the video sequences together to create a 

15 continuous, real time game. (The first video image to appear 
on the screen after initial bootup, in the illustrated flow chart, 
is the manufacturer's logo). Commercials and inserts may be 
included, as illustrated, to help create the illusion that the 
game is being televised live. The video portion of such 

20 inserts might be either wide shots of the stadium and crowds 
or still pictures of individual players or team logos. These 
images may be combined with a graphics overlay of the 
information pertinent to the insert such as a player's 
statistics, current game statistics such as yards carried, 

25, passed, etc. League standing statistics or other information 
that can be compiled from database information may also be 
provided The graphics overlays would be generated by the 
graphics character generator 22. The video insert could also 
be a game clock which could be used very effectively during 

so the final moments of a game. 

It will be understood that certain game factors may be 
affected through programming of CPU 4. Those factors 
include: 

1) Team playing factors. Each team will have its own set 
35 of playing factors stored in memory. These factors will 
affect the outcome of the play, for example, a team with 
a high value of passing will have a better chance for 
completing a pass play than a team with a low passing 
play value. 

40 2) Field position. There is an established system for 
determining the chances of success for a run or pass play 
according to the field position of that play. This system is 
used by quarterbacks and coaches to help them determine 
when it is best to run or pass. We will be using this system 

45 or a system similar to it to assign values to a called play 
according to its field position. This will be most evidenced 
in field goal attempts. 

3) Momentum and Fatigue. As the game progresses, the 
teams will fatigue. We will already be including player 

50 response time in the game factors but we should also 
consider overall game fatigue so that the more physically 
demanding plays will be less successful near the end of the 
quarters and near the end of the game. However, there will 
be other game situation factors that will also be taken into 

55 account such as previous successes. In other words, when a 
team gets marching down the field, their morale will over- 
come factors such as fatigue to at least some extent and 
conversely would probably increase the defense fatigue. 

4) Random chance, Not every play will be subject to a 
60 random factor, in fact, a random factor will only be occa- 
sionally included in the game factors. The frequency of this 
random factor will probably be less than 1 in 10 plays and 
possibly as low as 1 in 100 plays. It is included to provide 
sudden surprises in the play of the game and is not intended 

65 to replace the "player vs. player" aspect of the game. When 
the random factor is occasionally included, its affect on the 
outcome of the play will vary according to its value. A value 
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of 0 (if it is being added into the equation) or 1 (if it is being 
multiplied) will have the least effect whereas a value of 100 
(or whatever the maximum value used) would have the most 
effect on the outcome of the play. When this maximum value 
or near maximum value is used it will overpower the other 5 
game factors and, depending on the value of these other 
factors, be the deciding factor in choosing the outcome of 
the next play. In this way even the worst possible call from 
the worst possible field position can result in a great play 
providing the random factor is used and it's value is suffi- 1Q 
ciently large enough to overpower the other factors used. 
(Note: Penalties, fumbles and interceptions will not be 
determined on a random chance basis.) 

When overall game factors are taken into consideration, 
this should stQl be a game of skill. When everything else is X5 
equal, the player who calls the right plays at the right time 
should do better than the player who calls it wrong. 
However, for any single play there will always be that 
random possibility that even the most novice player can 
score a touchdown from the worst pos sible field position. On 2Q 
the other hand, since the random factor is only occasionally 
used, it is also possible for a novice defensive player to guess 
exactly what the quarterback is going to do next and block 
any gains in yardage. A series of good guesses could 
effectively beat even a skilful experienced player. 25 

In addition, several variations of control modules 6 and 
other types of input devices are envisaged: 

1) Two input devices: This is the system described above 
and is the simplest form for public use. 

2) Four input devices: By introducing four input devices 30 
into a bar area one input device can be designated for 
each offensive and defensive line on each team. In this 
way, since input devices will probably be physically 
attached to the table to prevent theft, this will now 
involve four tables in the bar, actively involving more 35 
patrons, making it more attractive to use. 

3) Multiple input devices: It could also be beneficial to 
provide a multiple input system so that every table in 
the bar can become involved with this system. Hie 
microprocessor would determine which play is called 40 
by using the most common input. This could work 
exceptionally well with the following option. 

4) Modem TV network: Since this game format will not 
be generating images in the sense that most "computer 
game" programs construct images based on current 45 
game conditions, the main CPU 4 will be mostly 
concerned with the sending and receiving of game play 
instructions and game play statistics, making decisions 
on which video sequences to play next and the locating 
and cueing them up for playback. In computer terms 50 
this is a relatively easy task and places only a relatively 
small load on the main CPU 4. Therefore, if two game 
machines are loaded with the same programs and 
video/audio sequences, a modem link of microproces- 
sor control commands should be able to produce the 55 
same program at both locations at the same time. This 
.would enable networking between game systems in 
different locations and enable emulation of a closed 
circuit television network. 

Thus it is apparent that there has been provided in 60 
accordance with the invention a player interactive live action 
football game that fully satisfies the objects, aims and 
advantages set forth above. While the invention has been 
described in conjunction with specific embodiments thereof, 
it is evident that many alternatives, modifications and varia- 65 
tions will be apparent to those skilled in the art in light of the 
foregoing description. Accordingly, it is intended to embrace 
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all such alternatives, modifications and variations as fall 
within the spirit and broad scope of the invention. 
What we claim as our invention: 

1. A pre-recorded, live action and sound, full motion 
video, interactive athletic contest comprising players of 
opposite teams playing at various positions on a background 
field, the game comprising: 

(a) a random access storage and retrieval means; 

(b) said random access storage and retrieval means for 
storing a plurality of individual, pre-recorded video 
images representative of live action plays of the athletic 
contest illustrating interaction of players of the opposite 
teams; 

(c) a microprocessor and microprocessor control means 
electronically associated with said random access stor- 
age and retrieval means for enabling one or more users 
to select in sequence through said control means dif- 
ferent ones of said plays according to play type, the 
microprocessor then, by using statistical tables, to 
select the video image of the actual play according to 
play type selected by the user; and 

(d) display means electronically associated with said 
microprocessor enabling the selected plays to be 
viewed by the users, said microprocessor further pro- 
grammed to evaluate and accumulate play results and 
report them to the users. 

2. A game according to claim 1 wherein said random 
access storage means is selected from the group comprising 
laser disc, CD-ROM, computer hard drive and optical or 
magnetic storage means. 

3. A game according to claim 1 further provided with 
audio storage and retrieval means, the audio retrieval means 
correlated with the individual pre-recorded live action plays 
and arranged so as to provide audio commentary corre- 
sponding to the plays displayed on the display means 
through speaker means electronically associated with the 
microprocessor and display means. 

4. A game according to claim 1 further provided with 
audio storage and audio generation means including synthe- 
sis means, the audio generation means correlated with the 
individual pre-recorded live action plays and arranged so as 
to provide audio commentary corresponding to the plays 
displayed on the display means through speaker means 
electronically associated with the microprocessor and dis- 
play means, said audio further selected to correspond to the 
yardage related to the play at any given time. 

5. A game according to claim 3 wherein a plurality of 
individual commercial messages are stored in said random 
access storage means and accessed according to the time 
which has elapsed during play, said commercial messages to 
be displayed on said display means at predetermined times, 
and audio signals to accompany said commercial messages 
when displayed on said display means. 

6. A game according to claim 1 wherein said display 
means are selected from the group comprising T.V. monitors 
and display screens. 

7. A game according to claim 1 wherein said micropro- 
cessor is programmed to provide outcome play results based 
on stored team statistics incorporating a teams strength, 
momentum and fatigue. 

8. A game according to claim 1, wherein said random 
access storage means is selected from the group comprising 
laser disc, CD-ROM, computer hard drive or optical or 
magnetic storage means, said game being further provided 
with audio storage and retrieval means, said audio retrieval 
means correlated with the individual pre-recorded live 
action football plays and arranged so as to provide audio 
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commentary corresponding to the plays displayed on the 
display means through speaker means electronically asso- 
ciated with said microprocessor and display means; said 
display means being selected from the group comprising TV 
monitors and display screens. 

9. A game according to claim 1 wherein the pre-recorded 
plays are displayed on a normal field that includes markings 
of yardage lines and numbers, said game then to be played 
with a limited number of field positions from which the ball 
can be scrimmaged, the results- of each play used therein 
being compatible with these limited number of field posi- 
tions. 

10. In a video game for generating and displaying on a 
display device a contest of opposing teams to be played by 
at least one user, each team comprising at least one 
character, the contest to be carried out at variable positions 
on a playing field, apparatus for displaying a selected one of 
a plurality of first images representing predetermined contest 
plays, said apparatus comprising: 

(a) means for storing said plurality of first images of 
contest plays; 

(b) means manually actuated for providing a signal 
indicative of a selected one of said plurality of first 
images of the contest plays to be displayed; 

(c) means responsive to said signal for accessing from 
said storing means the selected one first image of a 
contest play to be displayed; 

(d) means for determining the variable playing field 
position as a results of the contest of the selected one 
first image of a contest play; and 

(e) means for generating a second image relating to text 
and numerical information representative of cumula- 
tive team and player statistics as they apply to a contest 
in progress; and 

(f) means for superimposing said selected one first image 
of a contest play and said second image. 

11. A pre-recorded, live action and sound with electroni- 
cally generated graphics overlay, full morion video, inter- 
active game to be played on at least one viewing screen by 
at least one user, said game comprising: 

(a) random access storage and retrieval means for storing 
a plurality of individual, pre-recorded football plays 
illustrating interaction of players of opposite teams, a 
plurality of individual commercial messages being 
stored in said random access storage means and 
accessed according to the time which has elapsed 
during play; 

(b) a microprocessor and microprocessor control means 
electronically associated with said random access stor- 
age and retrieval means for enabling at least one user to 
select in sequence through said control means different 
ones of said plays according to play type, said micro- 
processor then, by using statistical tables, to select the 
video image of the actual play according to play type 
selected by the user, said microprocessor further pro- 
grammed to evaluate and accumulate play results and 
report them to the user in a meaningful way; and 

(c) display means electronically associated with said 
microprocessor for enabling the selected plays to be 
viewed by the users; said audio storage and retrieval 
means comprising audio retrieval means correlated 
with the individual pre-recorded football plays and 
arranged so as to provide audio commentary corre- 
sponding to the plays displayed on said display means 
through speaker means electronically associated with 
said microprocessor and said display means, said com- 
mercial messages to be displayed on said display means 
at predetermined times, and audio signals to accom- 
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pany said commercial messages when displayed on 
said display means; 
the pre-recorded football plays are displayed on a normal 
field that includes markings of yardage lines and 
5 numbers, said game then to be played with a limited 
number of field positions from which the ball can be 
scrimmaged, with the results of each play used therein 
being compatible with these limited number of field 
positions. 

1° 12. A pre-recorded, live action and sound with electroni- 
cally generated graphics overlay, full motion video, inter- 
active game to be played on at least one viewing screen by 
at least one user, said game comprising: 

(a) random access storage and retrieval means for storing 
15 a plurality of individual, pre-recorded football plays 

illustrating interaction of players of opposite teams, a 
plurality of individual commercial messages being 
stored in said random access storage means and 
accessed according to the time which has elapsed 
20 during play; 

(b) a microprocessor and microprocessor control means 
electronically associated with said random access stor- 
age and retrieval means for enabling at least one user to 
select in sequence through said control means different 

25 ones of said plays according to play type, said micro- 
processor then, by using statistical tables, to select the 
video image of the actual play according to play type 
selected by the user, said microprocessor further pro- 
grammed to evaluate and accumulate play results and 

30 report them to the user in a meaningful way; and 

(c) display means electronically associated with said 
microprocessor for enabling the selected plays to be 
viewed by the users; said audio storage and retrieval 
means comprising audio retrieval means correlated 

35 with the individual pre-recorded football plays and 
arranged so as to provide audio commentary corre- 
sponding to the plays displayed on said display means 
through speaker means electronically associated with 
said microprocessor and display means, said commer- 

40 rial messages to be displayed on said display means at 
predetermined times, and audio signals to accompany 
said commercial messages when displayed on said 
display means; 

the pre-recorded football plays are displayed on a normal 
45 field that includes markings of yardage lines and 
numbers, said game then to be played with a limited 
number of field positions from which the ball can be 
scrimmaged, with the results of each play used therein 
being compatible with these limited number of field 
M positions, and the pre-recorded football plays are seam- 
lessly displayed in such a manner as to appear to be a 
live television broadcast 

13. A game according to claim 12 wherein the pre- 
recorded football plays are provided with mapping means 
comprising a standardized system of timing, cueing and edit 

33 points in order to achieve the seamless display and appear- 
ance of a live broadcast 

14. A game according to claim 13 wherein the pre- 
recorded football plays are provided with control means 
comprising a standardized system of tuning, cueing and edit 

60 points so that a last portion of any video sequence being 
played overlaps a first portion of a next video sequence by 
a controlled and precise amount so that the next two video 
sequences can be edited together using video editing tech- 
niques selected from the group comprising dissolve, wipes, 

65 and other digital video effects. 

* ♦ * * * 
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ABSTRACT 



A sound-illustrated, bound book includes sound record 
areas in the form of a spiral sound groove each associ- 
ated with individual pages. Adjustment perforations or 
embossments or engravements and switch-on safety 
elements, if provided, for a sound reproducing appara- 
tus attachable in aligned position, arc associated with 
each sound groove. It is suggested to provide the sound 
grooves with the adjustment perforations and the 
switch-on safety elements on separate double pages of 
plastic material, at best being semi-rigid, and bound in 
the book, inserted into the quaternia thereof, in order to 
permit more favorable production of the individual 
book pages and of the sound groove carriers and to 
prevent any obstruction when the book is read with a 
sound reproducing apparatus having a revolving pickup 
placed on the sound groove and to avoid too much 
bulging of the book, especially toward one side. The 
sound grooves may be provided at the front and back 
sides of the sound record pages so as to be disposed 
directly opposite each other. The adjustment perfora- 
tions or engravements and embossments as well as the 
switch-on safety elements may be arranged symmetri- 
cally with respect to two orthogonal central axes of the 
sound grooves such that they will be in common for the 
oppositely disposed sound grooves. The switch-on 
safety elements are embodied by an upwardly protrud- 
ing embossment and a downwardly protruding en- 
gravement located close to the embossment. 

18 Claims, 9 Drawing Figures 
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■ \.. • vu , ■ abutments forming stops and acting as adjuster elements 

, SOU1W-ILLUSTRATED, BOUND BOQK ,. fqr engagementwi^ 

. ,, . (: ; . . ..... the casing. of which is provided with a; downwardly 

The invention relates , to a sound-illusttated, . .bound protruding annular socket to act as an adjuster matching 
book, comprising sound record areas mithe.fornjL.qf a 5 element sq as to obtain centering with respect, to the 
spiral sqund groove each and associate^! .with individual sound groove. (Japanese Pat. No. 436 403/sho 39-ljS 
printed , pages, and associated with the sound groove 159). In another known embodiment .of the sound re- 
adjuster elements, , and, pqssjjbly, switchK)n safety ele-. cord consisting of an acqustic foil bonded to the book 
ments for a sound reproducing apparatus attachable in pages and including a spiral sound track, two adjust- 
aligned position for in^ractiqn with the elements men- 10 ment perforations are provided at the edge , outside of 
tioned by adjuster matching element's provided at its the area, taken up by the sound groove to act as adjuster 
underside and, possibly, :s\yitch-6n safety matching ele- elements for centering, in this case the.sound reproduc- 
ments. . . ing apparatus includes two feet at its underside to serve 
So-called sounding books or sound-illustrated books as. adjuster,, matching elements for engagement in the 
for children are known particularly for educational 15 perforations up.qn correct association (German Pat. ^q. 
purposes, to teach languages, or as travel "guides and the 20 01 283). . 

like. On individual pages these books have sound record When the, sound ^reproducing apparatus has been 

areas in the form of 'individual spiral sound grooves aligned ; properly ,,above the sound , groove of a book 

which may be provided either; Sy' bfe'irig impressed di- page, it is switched; on {by actuating aiwitch normally 

rfectly intp the _pages, : which arc given a corresponding 20 provided, atats- upper side. Thereupon the pickup of the 

specific surface design,- spch as ' being ;lamihated with a apparatus, is ; Jqwe^ .^au^mytic^y from its retracted 

plastic -film, -or by being' formed in seriarate sound re- position. to scan the^^ tracking of 

cording media (acoustic ! foils) bonded to the jpages'. 1 Iri the sound groqye , has: been cqmpljeted, the apparatus 

teaching, especially-seif-t'eaching the visual illustrations may be switched.pff .a.utomajjcaUy just like, an ordinary 

or writteri information thus may be ; supplemented : ahd 25 record piayer, arid this :wiU return the pickup: automati- 

emphasized by acoustic data of abbut 1-3 minutes dura- cally into its retracted, starting posidon.. . : • 

tion contained in the ' sound 'groove. - Sound ' grooves , It, is a disadvantage of .such attachable sound, repro- 

impressed in or glued bri the text bf a page of the book duping apparatus; having a revolving , pickup that, they 

at a suitable location have the disadvantage of causing ' may be switched pn especially. hyshU^ren long before 

partial cover-up of the . passages of the text to be illus- 3Q they have- reached tlieir iproper position above the 

trated, as seeh ; from the part bf the reader, by the sound sound groove. This may cause : the ye ty sensitive pickup 

reproducing apparatus attached. Even- if no such appa^ stylus to contact surfaces, of tables, book-pages, edges of 

f atus is attached,: the .sound grooves, are' irritating be- sound recqrds, ano^the lfte and, .therehy, suffer damage, 

cause they disturb 'the clarity of the letters and images; The risk is the same if engagement is established with 

This is true also if the sound grooves are located at the 35 difficulty only ; between- the adjustment , means of the 

respective ; opposite 1 sides of the. two open pages of the sqund record, and tlje matching adjustment means of the 

book. Irt't both- cases- it is a" disadvantage of impressed sound reproducing apparatus . so - that , the apparatus will 

sound grooves that -the corresponding sound-illustrated be turned oh easily .even before it has been associated 

page with* printed- text of the hook must be produced properly , with f the sound grppve. 

separately from the other 'book pages. Acoustic foil 40 ...It is known ta eliminate Jhis disadvantage by provid- 

bonded;on r the pages causes one-sided bulging. Bonding ing the.sound record outside of the sound groove with 

of the sound recording -medium by the maker of the switch-on. safety elements which, must be sensed and, 

book forbids Itself for price reasons. perhaps, pivoted by sensor pins of the .sound reproduc- 

It is known (German. Pat. No^23;58 1 10)- to provide ing element acting as switch-on safety matching ele- 

the sound grooves separately on pivotable, semi-rigid 45 ments before the circuit can be closed ■ to - drive the 

book pages so as to avoid the; problem of coordination pickup arm turntable with the pickup arm. The. sound 

between the? sound grooves^ and the ■ text in the book reproducing.apparatus may .comprise conductive sensor 

itself as well as poor readability. This has the disadvan- pins bridged by an electrically conductive coating in the 

tage that, as a rule> a book can be provided only at the form of a contact film (German application print 21 55 

left side or at the right side of : a book jacket with a foil 50 910) disposed in. proper position on the sound record. In 

having impressed sound grooves and corresponding in this manner the.sound reproducing apparatus cannot be 

size to a page of the book. The proportion of sound thus switched on . or the pickup . cannot be moved into its 

is low as compared to the text contained in the book. operating position unless the sound reproducing appara T 

Another , known proposal was : accepted still less in tus has been attached in correct alignment 

practice.. It provided for a singles-sound groove on indi- 55, . In another known, embodiment of a sqund reproduc- 

vidual,. semi-rigid, pages of a copy-book so as to cover ing apparatus including a switch-on- safety means (Ger- 

essentially the entire*. page ; The individual pages are man patent application laid open 24.30 377) the closing 

interconnected by a helical spring or the like to form, a contact is located in the reproducing apparatus and it is 

copy-book (British : Pat. No. 8.00 996). . matched in height with the switching and sensing pin 

The sound grooves provided on book pages or book 60 such that it cannot be closed unless, the .point of the 
covers are : played back by a small attachable , sqund sensing pin is positioned above the plane of attachment 
reproducing apparatus including ^a s ^circulating pickup of the reproducing apparatus. To this end an upwardly 
head which follows the track of -the sound* an amplifier, protruding , embossment (wart) is formed in the sound 
and a loud speaker- as well as the necessary piles or a ; recprd;. / and the association in height between the clos- 
storage battery for energy supply. Correct; coordination 65 .ing contact and the sensing pin is such that the contact 
between the sound reprpducingapparatus arid the spiral is closed only when the sensing pin rests on the emboss- 
sound groove can be obtained -by- surrounding .the sound nient. . It is known that the switchron ^safety of this means 
groove with a. protruding; guide. groove qr projecting cjm,.be enhanced, still further by forming next, to the 
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embossment an aperture, such as a hole and by provid- each and associated with individual printed pages, and 
ing another sensing pin resiliently supported in height in associated with the sound groove adjuster elements, 
the reproducing apparatus. This sensing pin must ex- and, possibly, switch-on safety elements for a sound 
tend through the aperture down to the sound recording reproducing apparatus attachable in aligned position for 
substrate in order to close the closing contact. If two 5 interaction with the elements mentioned by adjuster 
sensing pins are provided, they must be at different matching elements provided at its underside and, possi- 
levels so as to permit closing of the operating, circuit. bly, switch-on safety matching elements, in that the 
The or each sensing pin, in general, will not be able to sound grooves with the adjuster elements, and switch- 
adopt its desired position unless the sound reproducing 0 n safety elements, if provided, are provided on sepa* 
apparatus rests in proper alignment on the sound record 10 ra t e sound record double pages of plastic material 
or on the book page rather than, for instance, being bound in the book and inserted into the quaternia 
placed directly on a flat book page or table top. thereof (folded printed sheets for, e.g. 8 leaves having 

The provision of switch-on safety elements at the j$ pages) and the adjuster elements, and the switch-on 

sound record has proved to be practically just as neces- sa f ety elements, if provided, are arranged symmetri- 

sary for substantially eliminating the risk of damaging 15 ca u y w j t h re spect to a central axis of the sound grooves, 

the pickup head as the provision of adjustment perfora- complete separation between the production of 

tions or other means, such as raised grooves/stampings, t jj e pa g es anc j t fc e production of the sound record 

and the like to achieve properly aligned coordination. pages ma fc es j t possible to select for each of these manu- 

Considerable technical manufacturing difficulties are f acturcs the most favorable conditions, regardless of the 

encountered and substantial extra expenditure is re- 20 other when binding the book, the semi-rigid double 

quired to form book pages with sound grooves because pages of acoustic sheeting including the impressed 

not only the manufacture but also the material of the gound grooves are inserted at the desired locations and 

book pages must be suitable for, making .the sound bound imo the book ^ SQund record pages may be 

grooves. Furthermore, the arrangement of the sound turne d over like any other page of the book. Books not 

grooves must be made in consideration of the arrange- 25 containing sound .illustrations so far may be issued prac- 

ment of the text on the pagey and of the playback by ^ fof the ^ ^ M m SO und-illustrated books 

means of the attachable sound reproducing apparatus. ^ bUshin ft new ^ b insertin the 80und 

The whole make-up of the book thus becomes difficult. recor / double * in ^ quatern ia. The sound record 

In addition raised adjusting means cannot be distnb- ^ fa ^ Wndi ^ ^ ^ 

uted at 30 tionaladvantagethatsoundgroovesmaybeprovidedat 

entail one-sided ^f ke %P?^ both sides of The sound record such that they are di- 

more, in considemion of the ^ . h Qth hay . ^ ^ cent ^ 

impossible to cover the entire book page with sound that Adjuster elements as well Is the switch-on safety 

grooves. t u„^ f ± A u rtrt u u**A n <> -x* elements are located in such positions as to be shared by 

For this reason a wund ;^*^ 35 the oppositely disposed sound grooves. Consequently 

bound pages normally l^.duc^ " m at ^ wiceAe amount of audio information can be furnished 

covered by a^rotective film to be peeled off, were f ™™ ZT^Al JSLT" 
made separately from the book and later on glued into 40 ^re, the book becomes less thick. 

may not be made of opaque plastics because in that at one side only if sound-iHusfra Uon » *»^™* 

event it could be glued only on larger sections without respect to one book page only. This will be the case m 

an v text particular with pages bound near the beginning and the 

It is the object of the invention that a sound-illus- 45 end of the book because only that book page > can be 

trated book, having sound grooves, impressed in a sepa- P^ced in sufficiently flat f^^^S^^ f 

rately producible acoustic foil, associated with passages has the greatest number of book pages underneath. If 

of the text on the individual pages for illustration sound record pages are provided with sound grooves 

thereof and adapted to be played back by means of an on both sides, it is possible to find the sound-illustration 

attachable sound reproducing apparatus, the feet or 50 of a book page on the opposite sound record page and 

bottom of which are inserted in corresponding perfora- vice versa. ; 

tidns of the acoustic foil or placed between impressed Neither the image nor the text of the book pages are 

formations, and which preferably cooperates by switch- disturbed by the attached sound reproducing apparatus 

on safety means, particularly resiliently supported sens- or by the sound grooves. Arranging the adjuster ele- 

ing or switching pins located in the switch-on circuit, 55 ments and the switch-on safety elements symmetrically 

1 with raised or depressed formations, should be modified with respect to orthogonal central axes, preferably at 

such that more advantageous, and less expensive com- both sides of the sound groove area facilitates perfect 

plete manufacture by the publishers or book manufac- attachment of the sound reproducing apparatus. If the 

hirers is permitted and no completion by the purchaser sound record double pages are located close to either 

is required, and that the book as a whole becomes thin- 60 one of the two book covers and the arching of the pages 

ner, but not at the expense of the sonic quality because becomes very pronounced in the one quire, in this man- 

of the use of thinner acoustic foils. Tracking .of the ner the sound reproducing apparatus may be attached 

sound grooves is to be permitted without any. coverage such that the switch-on safety elements are close to the 

or obstruction of view caused by the sound reproducing lateral margin so as to extend approximately parallel to 

apparatus. 65 the side edge and thus not be influenced by any arching. 

This object is met, in accordance with the invention, As the playback of $ouhd records in books is not alto- 

the sound-illustrated, bound or sewed book comprising gether unproblematic because of the curvature of the 

sound record areas in the form of a spiral sound groove open book, the sound grooves should be as far outside 
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as possible, away from the back of the book because the of this embodiment of the adjuster elements, two other 
arching is greater near the back. adjustment perforations in the area of the tw upper 

None of the sound grooves impressed disturbs one or corners of the square circumscribing the sound groove 
the other side. The simpler manufacture is advanta- are associated with each sound groove. With all adjust- 
geous because all sound grooves for adjacent book 5 ment perforations located at the corners ofa square, the 
pages may be combined on one piece of sheeting or foil sound reproducing apparatus may be attached in posi- 
so that they may be formed in a single process of im- ttons which are orthogonal with respect to each other, 
pression without disrupting the coordination. The The provision of four perforations for adjustment has 
acoustic sheetings for two sound grooves to be ar- the advantage that the sound record page cannot be 
ranged opposite each other may be thinner not only 10 arched or warped under the sound reproducing appara- 
because sound grooves are provided at both sides but tus attached in properly aligned position. With only two 
also because the adjustment perforations as well as the perforations this could happen because the sound repro- 
switch-on safety elements are shared by the two super- ducing apparatus must be supported at least at three 
posed sound groove areas. The perforations of the places of which ^ e third one j^ys would be on ^ 
sound groove pages or sound sheetings thus are used 15 80Und record pagCt If thc repr oducing apparatus 
from both sides. The same applies to the switeh-on should become displaced slightly after attachment so as 
safety elements. ■ ■■ t0 effect engagement between the feet thereof and the 

It is provided in a modification of ^e invention that Mjustment perforations, thin sound recording sheetings 
the switcn-on satety elements are embodied by an up- ht suffer 

stress. 

wardly protruding embossmenl tand a^downwardly pro- 20 u fouf adju8tment perforations arc provided, the 
truduig engraveroent close to the embossment, and that sound gfooves on t of egch othef „ e 

these are shared by the two sound grooves oppositely more ^ appro ~ hed l0 other> ^ , he ' best 
disposed onjhe top and back side ofa page of the sound posibi) . J JZ^^ 

record double page. Every upwardly protruding em- Acco ; di to another embodiment, of the adjuster 
bossment of the sound sheeting effects a downwardly 25 element8 fecord ^ ■ ^ pages J conl . 

protrudmg engrayement or setback at the opposite ade alternating adjuster embossments and 

Therefore, to obtain a certain switch-on safety means ^ t *. " i_ j 

which requires^ certain difference in level of the two engravements concentric with each sound 

safety sensing pins of the sound reproducing apparatus, }F*™ ™ e enibossments and engravements may be 
the sound record pages are thinner becausi the eleva- 30 * ° n< ? ° r besides ?>y a cu into the sheeting, 

tionsanddepress^^^ Wl * thls of the **** 

common for both sides (sound grooves); embossments and engravements are effective at both 

Impressing sound grooves in both sides of the acous- f^f of each sound record page. At the^ same time, 
tic foil makes it necessary to position the sound grooves furthermore, they can fulfil the function of the switch- 
exactly opposite each other on the top and back side of 35 <* ele * ents in that * le f< ° n ? 8ensm S f m 
each page of a sound record double page, as is the case f oufl d reproducing apparatus (switch-on safety raatch- 
with an ordinary record. Then, however, the adjust- in S element).must scan one embossment or engrave- 
ment perforations and the impressed formations are mcnt * hen the adjuster matching elements of the sound 
disposed symmetrically with respect to each other, and reproducing apparatus fit in form lock on and into the 
this has the consequence that no further thickenings are 40 embossments and engravements. 
caused. The switch-on safety elements need not neces- . ™ny «sei ; it will be deemed particularly conve- 
sarily be of the embodiment indicated. According to a nient lf the ^ord pages of the book are made of 
mbdification of the invention, for instance, the switch- a transparent plastic material, in other words if suffi- 
on safety elements on the acoustic foil are embodied by gently rigid transparent acoustic sheetings are used, On 
an impressed microprism area, especially one having a 45 the other hand, better sonic quality is obtainable, partic- 
narrow reflection profile oriented in a certain direction with thinner sound record pages, if dark plastic 

and adapted to be scanned photoelectrical^, particu- material, especially filled with graphite is used. Many 
larly by means of a light reflection barrier. Such a mi- conventional records are made of such filled plastic 
croprism area may be imprinted in plastic film material material. The sound record sheeting need no longer be 
just like the sound grooves. As it does not add to the 50 transparent as the illustrative part of the book and the 
thickness! this embodiment has no areas at all which part to be read are to be found on opposite pages each, 
project beyond the surface of the sound record page so According to another modification of the invention 
that there is no one-sided thickening, no matter how the the sound record pages project laterally beyond , the 
sound grooves and the associated switch-on safety ele- book pages and are formed like a margin index on 
ments are arranged. On the other hand, the fact that 55 which pages could be indicated or an alphabetic infor- 
several sound grooves each are provided on one sound mation given similar to an index. In this manner the 
recdrd page always makes it possible to find a dispo- desired sound-illustrations and the corresponding chap- 
sition for the switch-on safety elements in the form of ters of the book would be easier to find. Since the sound 
impressed formations which will provide a uniform record pages are made of plastic sheeting which, at best, 
distribution of the sound grooves across the surface area 60 is approximately semi-rigid, their resistance is adequate 
so that one-sided thickenings adding up in a book with for longer periods of use. 

many sound record pages have no disturbing effect, The invention will be described further, by way of 

It is convenient also with the sound-illustrated book : example, with reference to the accompanying drawings, 
according to the invention to have an adjustment perfo- in which: 

ration each associated with each sound groove; espe- 65 FIG. 1 shows an open, bound book, having a book 
cially at either side of the switch-on safety elements, in page oh the left side and a sound record page of a sound 
the area of the two lower corners of a square circum- record double page on the right side; 
scribing the sound groove. According to a modification FIG: 2 -shows the sound record page of FIG. 1; 
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FIG. 3 is, a cross sectional elevation of .the sound to the left so that .the backside carrying page, number 

record page along line 3^3. in JFIG.. 2; . \ . 206 faces the reader. It also carries sound grooves 7 for 

FIG. 4 shows the. book of FIG. 1, yet with the sound sound illustration . of the right book page which carries 

record double page turned oyer; v . page number 207.. The sound grooves 7' are positioned 

FIG. 5 shows the sound record page of FIG. .4; , 5 exactly opposite the sound grooves 7 of sound record 

FIC5. 6 is a cross sectional elevation of . the sound page 203 so that they have a common .middle on the 

record page along line 6 — 6 in FIG. 5; : ' central line 11. Outside of the sound groove the adjust- 

FIG. 7 is a top plan view of a sound record double ment perforations 8 are visible also on page number 206 

page having four sound grooves on which a; sound of the -sound record page 4", Here* however, the 

reproducing apparatus may be placed properly aligned 10 switch-on safety elements 9 and 10 of the sound record 

in two orthogonal positions; page number 203 are reversed laterally. At the. left there 

FIG. 8 is a top plan view of a sound record double is the downwardly protruding engravement 10 and to 
page having common adjuster elements and switch-on the right thereof there is the upwardly protruding era- 
safety elements; and ' : bossment 9. These relationships will become apparent 

FIG. 9 is a partial crbss sectional elevation of the 15 from the cross sectional presentations of FIGS. 3 and 6. 

adjuster elements and switch-on safety elements along Upon turning over the sound record pages 4' and 4", 

line 9 — 9 in FIG. 8. ' therefore, the sound grooves 7' on the backside thereof 

FIG. 1 sh<>ws a usctal bound book 1 opened in the can be tracked by means of a sound reproducing appara- 
middle. The individual* book : pages 2 are disposed be- tus. The safety, functions again are, fulfilled by the ad- 
neath book covers 3. The normal book page 2 haying 20 justment perforations 8, as far as properly aligned at- 
page number 202 and preseh tachment is concerned,: and by the . switch-on safety 
of a swinging 'garage door ' is followed tiy a sound record elements 9 and 1Q, ■ as far >as switch-on upon proper 
double page 4 of transparent', semi-rigid plastic sheeting alignment is concerned. Each; embossment of a front 
which can be turned over about as easily as the book page has become, an engravement of the back page.. As 
pages 2 and is inserted' into a quarternion of the book 25 both sides of .the acoustic sheeting maybe impressed 
and bound together with the book. Each sound record with sound grooves opposite each other as. on a record 
page 4- and 4", respectively, projects beyond the book disc, the costs of material and manufacture, of the sound 
volume by approximately i cm, presenting an index lug record double pages 4 .to be bound in the, book are. re- 
5 at the upper part of the right side in FIG: 1. Apart duced quite considerably. The novel design of the book 
from that the book 'pages 2 arid the sound record jpages 30 makes it less thick than before in spite of the great num- 
4' and 4'S respectively, have the same size. ber of sound grooves included. • ■ . 
< The sound record pages ; 4' comprise two "impressed FIGS. 7 and 8 each show an unfolded sound record 
spiral sound -grooves 7 disposed one above the other double page 4 consisting of a left sound record page 4' 
symmetrically with respect " to a central 1 line 11 of the and a right sound record page 4". In. the embodiment 
sound.record pages 4' extending ; parallel to the back of 35 according to FIG. 7 each side comprises four sound 
the book and :with respect to central-lines 11' extending grooves 7. It is quite possible to move ; the sound 
parallel to the upper book edge. Adjustment perfora- grooves closer together, so that at least six sound 
tions 8 embodied by holes extending from one side to grooves can be taken up by each page; The adjustment 
the other are located at the corners of a square imagined perforations 8 beipw and above the sound grooves are 
as circumscribing each sound groove 7. The upper ad- 40 separated, from the: adjustment perforations ..8' at both 
justment perforations 8 of the lower sound groove 7 at sides of the sound grooves. This means; that the adjust- 
the same time: are the lower adjustment perforations of ment perforations 8. cannot be . used when ; the sound 
the upper sound groove 7. It is : not necessary that the reproducing apparatus is attached laterally; then the 
design be such: as' described above. ; ' lateral perforations 8' are used instead. 'This design is 
: Switch-on* safety elements embodied by an upwardly 45 necessary if , the -feet of the sound reproducing apparatus, 
protruding: embossment and an -adjacent, downwardly serving as adjuster matching elements are closer to- 
depressed or setback engravement 10 are disposed be- gether. On the other hand, adjustment again is provided, 
tween the respective iower adjustment perforations 8 by the four feet of the sound reproducing apparatus in 
arid those close to the margin of the page. These em- order to avoid any warping of the sound record page 
bossments and engravements are scanned by sensing 50 during the alignment. Switch-on safety embossments 9 
pins of the sound reproducing apparatus which is placed and engravements 10 are provided below each sound 
on the book page .with its feet to engage in the adjust- groove as well as laterally thereof towards the outside;; 
ment perforations 8. The sound reproducing apparatus The embodiment according to FIG. 8 shows each 
cannot be switched-on unless the sensing pins bear on sound groove surrounded by a ring of alternating ad- 
the embossment or engravement. Two more switch-on 55 juster embossments 15 and adjuster engravements . 16,, 
safety embossments and engravements 9 and 10, respec- which ring is concentric with the middle of the : sound 
lively, are located at both sides of the central lines 11' of groove. On the left sound record page. 4' the eraboss- 
the sound grooves 7 which are orthogonal to the central ments are hmited radially inwardly and outwardly with 
line 11 extending parallel to the back of the book, and respect to the ; center by cuts, whereas, the , embodiment 
each facing the outer margin of the sound record page 60 shown pf the right sound carrier page 4'V }ias;the, e.m- 
4' so that the sound reproducing apparatus may be at- bossments and : engrayements. ,15 and 1^ limited by cuts 
tached laterally if this provides a better planar position only at the side facing the .center of the sound, groove, 
of the pages.in the region of the. switch-on safety ele- whilethey merge directly into; the sound carrier page 4" 
ments, which is the case close to the first and last pages at the outer side. In thi§ case it fte sound reproducing 
of the book. .. : 65 apparatus is provided at its underside with .correspond? 
* The bound book according to FIG. : 4 shpws..the t ing adjuster matching elements ; for formlqck engage-, 
sound record page 4' provided with page number 203 in ment oyer and into the embossments r and engravements. 
FIG. 1 and the other sound record page 4" turned over In at least one of these adjuster -matching elements a 



12/22/2003, EAST Version: 1.4.1 



4,425,098 



sensing pin is provided to scan an embossment 16 or an 
engravement 15. If such sensing pins are provided in 
two feet, it is convenient to use one for scanning an 
embossment 16 and the other one for scanning an en- 
gravement 15. 5 

As shown in the right half of FIG, 8, the switch-on 
safety element may also be embodied by a microprism 
area which is impressed below, the sound groove and 
laterally thereof, facing the margin of the page, and 
adapted to be scanned photoelectrically. Microprism 1° 
areas are known in connection with focussing means of 
cameras. 

What I claim is: 

1. A sound-illustrated, bound book, comprising sound 
record areas in the. form of a spiral sound groove each 15 
and, associated with individual printed book pages, and 
adjuster elements associated with the sound groove for 

a sound reproducing apparatus attachable in aligned 
position for interaction with said adjuster elements by 
adjuster matching elements provided at its underside, ^° 
wherein the sound grooves with the adjuster ele- 
ments are provided on separate sound record dou- 
ble pages of plastic material bound in the book and 
inserted into the quaternia thereof and the adjuster 
elements are arranged symmetrically with respect 
to a central axis of the sound grooves. 

2. A sound-illustrated, bound book, comprising sound 
record areas in the form of a spiral sound groove each 
and associated with individual printed book pages, and, 3Q 
associated with the sound groove, adjuster elements and 
switch-on safety elements for a sound reproducing ap- 
paratus attachable in aligned position for interaction 
with said elements by adjuster matching elements pro- 
vided at its underside and switch-bn safety matching 35 
elements, 

wherein the sound grooves with the adjuster ele- 
ments and switch-on safety elements are provided 
on separate sound record double pages of plastic 
material bound in the book and inserted into the 40 
quaternia thereof and the adjuster elements and the 
switch-on safety elements are arranged symmetri- 
cally with respect to a central axis of the sound 
grooves. 

3. The book as claimed in claim 1, 45 
wherein the adjuster elements are disposed symmetri- 
cally with respect to two orthogonal central axes 
passing through the center of the sound grooves, 

4. The book as claimed in claim 2, 

wherein the adjuster elements and the switch-on 50 
safety elements are disposed symmetrically with 
respect to two orthogonal central axes passing 
through the center of the sound grooves. 

5. The book as claimed in claim 1 or 3, wherein the 
sound grooves at both sides of each sound record page 55 
are disposed directly opposite each other having the 
same center, and in that the adjuster elements are ar- 
ranged to be in common for the oppositely disposed 
sound grooves. 

60 



10 



6. The book as claimed in claim 2 or 4, 

wherein the sound grooves at both sides of each 
sound record page are disposed directy opposite 
each other having the same center, and in that the 
adjuster elements and the switch-on safety ele- 
ments are arranged to be in common for the oppo- 
sitely disposed sound grooves. 

7. The book as claimed in claim 2 or 4, 

wherein the switch-on safety elements are embodied 
by an upwardly protruding embossment and a 
downwardly protruding engravement disposed 
close to said embossment and that they are shared 
by the two oppositely disposed sound grooves. 

8. The book as claimed in claim 2 or 4, 

wherein the switch-on safety elements are embodied 
by an impressed microprism area adapted to be 
scanned photoelectrically. 

9. The book as claimed in claim 1 or 2, wherein as 
adjuster elements an adjustment perforation each is 
associated with each sound groove in the area of the 
two adjacent corners of a square circumscribing the 
sound groove. 

10. The book as claimed in claim 9, 

wherein two further adjustment perforations in the 
area of the other two corners of the square circum- 
scribing the sound groove are associated with each 
sound groove. 

11. The book as claimed in claim 1 or 2, 

wherein as adjuster elements the sound record double 
pages comprise a ring of alternating adjuster em- 
bossments and adjuster engravements concentric 
with each sound groove. 

12. The book as claimed in any of claims 1 to 4, 
wherein the sound record double pages of the book 

are made of transparent plastic material. 

13. The book as claimed in any of claims 1 to 4, 
wherein the sound record double pages of the book 

are made of dark plastic material. 

14. The book as claimed in claim 13, 

wherein the sound record double pages of the book 
are made of dark plastic material filled with graph- 
ite. 

15. The book as claimed in any of claims 1 to 4, 
wherein the sound record double pages project later- 
ally beyond the book pages and are formed like a 
margin index. 

16. The book as claimed in any of claims 1 to 4, 
wherein the sound grooves are provided at one side 

only of the sound record double page. 

17. The book as claimed in claim 6 wherein the 
switch-on safety elements are embodied by an upwardly 
protruding engravement disposed close to said emboss- 
ment and that they are shared by two oppositely dis- 
posed sound grooves. 

18. The book as claimed in claim 6 wherein the 
switch-on safety elements are embodied by an im- 
pressed microprism area adapted to be scanned photo- 
electrically. 
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METHOD AND SYSTEM FOR 
BROADCASTING DIGITAL AUDIO AND 
VIDEO TO AN ANALOG WIRELESS DEVICE 

RELATED INVENTIONS 

The present invention is related to the following inven- 
tions which are assigned to the same assignee as the present 
invention: 

Method and System for Distributing Digital Audio and 
Video to an Analog Wireline Device, filed May 4, 1998, 
having Ser. No. 09/071,046. 

Method and System for Broadcasting/Distributing Digital 
Audio and Video to a Television, filed May 4 1998, having 
Ser. No. 09,071,368. 

Method and System for Broadcasting Digital Audio to 
Radio, filed May 4, 1998, having Ser. No. 09/071,047. 

FIELD OF THE INVENTION 

The present invention relates generally to digital audio 
and video. 

BACKGROUND OF THE INVENTION 

A wide variety of digital audio and video content cur- 
rently exists. For example, computers can process or store 
audio and video data obtained via the internet and other 
sources. Consumption of digital audio and video is currently 
confined, however, to devices designed to accept a specific 
form of input. For example, a computer can play digital 
audio and video provided in a specific digital format which 
the computer is configured to process, but a current televi- 
sion cannot play the same digital audio and video data 
because it is designed to receive an entirely different form of 
input. Accordingly, it would be desirable to have the capa- 
bility of playing digital audio and video with devices 
designed to receive a different form of input. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a circuit diagram of a system for broadcasting 
audio and video to an analog device; 

FIG. 2 is a flowchart of the process performed by the 
system shown in FIG. 1; 

FIG. 3 is a flowchart of the process for processing a digital 
audio signal; 

FIG. 4 is a flowchart of the process for processing a digital 
video signal; and 

FIG. 5 is a flowchart of the process for outputting the 
digital audio and video to the analog device. 

DETAILED DESCRIPTION OF THE DRAWINGS 

In a preferred embodiment of the invention, a method and 
system is provided for broadcasting digital audio and/or 
video to an analog wireless device. More specifically, the 
preferred embodiment of the invention obtains digital audio 
and/or video signals and broadcasts the audio and/or video 
content of the digital signals to the analog wireless device. 
As a result, an analog wireless device which is not designed 
to receive digital audio or video can play the audio and/or 
video content. 

In one aspect of the preferred embodiment, an audio 
circuit broadcasts an analog audio signal to the analog 
wireless device. An audio input interface receives a digital 
audio signal and identifies an audio bitstream. Optionally, an 
audio digital decryption unit decrypts the audio bitstream. 
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An audio decoding unit then decodes the audio bitstream. 
The audio decoding unit optionally includes a decompres- 
sion component decompressing the audio bitstream. An 
audio digital to analog converter converts the decoded audio 

5 bitstream to an analog audio signal. Optionally, an audio 
analog decryption unit decrypts the analog audio signal. An 
analog transmitter transmits the analog audio signal to the 
analog wireless device. 
In another aspect of the preferred embodiment, a video 

10 circuit broadcasts an analog video signal to the analog 
wireless device. A video input interface receives a digital 
video signal and identifies a video bitstream. Optionally, a 
video digital decryption unit decrypts the video bitstream. A 
video decoding unit then decodes the video bitstream. The 

1S video decoding unit optionally includes a decompression 
component decompressing the video bitstream. A video 
digital to analog converter converts the decoded video 
bitstream to an analog video signal. Optionally, a video 
analog decryption unit decrypts the analog video signal. An 

20 analog transmitter transmits the analog video signal to the 
analog wireless device. 

In yet another aspect of the preferred embodiment, the 
audio circuit and video circuit are combined to broadcast an 
analog wireless output signal containing both audio and 

25 video content. An audio input interface receives a digital 
audio signal and identifies an audio bitstream. Optionally, an 
audio digital decryption unit decrypts the audio bitstream. 
An audio decoding unit then decodes the audio bitstream. 
The audio decoding unit optionally includes a decompres- 

30 sion component decompressing the audio bitstream. An 
audio digital to analog converter converts the decoded audio 
bitstream to an analog audio signal. Optionally, an audio 
analog decryption unit decrypts the analog audio signal. A 
video input interface receives a digital video signal and 

35 identifies a video bitstream. Optionally, a video digital 
decryption unit decrypts the video bitstream, A video decod- 
ing unit then decodes the video bitstream. The video decod- 
ing unit optionally includes a decompression component 
decompressing the video bitstream. A video digital to analog 

40 converter converts the decoded video bitstream to an analog 
video signal. Optionally, a video analog decryption unit 
decrypts the analog video signal. An analog transmitter then 
mixes the analog audio signal and analog video signal into 
an analog wireless output signal and transmits the analog 

45 wireless output signal to the analog wireless device. 

FIG. 1 is a circuit diagram of a system for broadcasting 
both audio and video to an analog device. In FIG. 1, an audio 
circuit 120 obtains a digital audio signal and produces an 
analog audio signal which can be distributed to an analog 

50 wireline device 100 or broadcast to an analog wireless 
device 110. The analog wireline device 100 is, for example, 
any one or more of a number of devices including, but not 
limited to, a cassette recorder, television, video cassette 
recorder, amplifier, or amplified speakers. The analog wire- 

55 less device 110 is, for example, any one or more of a number 
of devices including, but not limited to, a radio, television, 
cordless telephone or wireless speakers. 

The audio circuit 120 contains an audio input interface 
122, an optional audio digital decryption unit 123, an audio 

60 decoding unit 124, an audio digital to analog converter 126, 
an optional audio analog decryption unit 127 and an audio 
output interface 128. One of ordinary skill in the art will 
implement these components using circuitry best suited to 
the application at hand. For example, each of the compo- 

65 nents may be implemented with one or more chips or with 
software executed by a processor contained therein or in 
another component of the system shown in FIG. 1, such as 
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a control unit 130, which will be described in more detail 
below. The functions of these components will be explained 
in greater detail with references to the flowcharts below. 

Similarly, a video circuit 140 obtains a digital video signal 
and produces an analog video signal which can be distrib- s 
uted to the analog wireline device 100 or broadcast to the 
analog wireless device 110. The video circuit contains a 
video input interface 142, an optional video digital decryp- 
tion unit 143, a video decoding unit 144, a video digital to 
analog converter 146, an optional video analog decryption 10 
unit 147 and a video output interface 148. One of ordinary 
skill in the art will implement these components using 
circuitry best suited to the application at hand. For example, 
each of the components may be implemented with one or 
more chips or with software executed by a processor con- 15 
tained therein, or in another component of the system shown 
in FIG. 1, such as the control unit 130. The functions of these 
components will be explained in greater detail with refer- 
ence to the flowcharts below. 

An analog transmitter 150 mixes the analog audio signal 2 rj 
and analog video signal into an analog wireless output signal 
and transmits the analog wireless output signal to the analog 
wireless device 110. For example, where the analog wireless 
device 110 is a radio, the analog transmitter 150 transmits an 
analog audio signal in the FM or AM band. When both audio 2 s 
and video content are present, a synchronization unit 160 
synchronizes processing by the audio circuit 120 and the 
video circuit 140 to synchronize the output to the analog 
wireless device 110. If the audio and video are provided as 
an integrated digital input signal, a splitter 170 separates the 30 
digital input signal into the digital audio signal received by 
the audio circuit 120 and the digital video signal received by 
the video circuit 140. 

The control unit 130 obtains input from a user and 
controls the audio circuit 120 to play audio and the video 35 
circuit 140 to play video in accordance with the user input. 
The control unit 130 obtains input from a user and controls 
the audio circuit 120 to process the digital audio signal and 
the video circuit 140 to process the digital video signal in 
accordance with the user input. One of ordinary skill in the 40 
art will readily implement the control unit 130 in any of a 
number of different ways, depending on the environment 
and end device to which the system is applied. For example, 
where the analog wireless device 110 is a radio, the control 
unit 130 can be implemented as a control panel or remote 45 
control device which obtains a frequency selection from a 
user and controls the analog transmitter to transmit the 
analog audio signal at the radio frequency selected by the 
user. The control unit could also obtain a selection of the AM 
or FM band by the user. As another example, where the 50 
analog wireless device 110 is a television, the control unit 
130 can be implemented as a control panel or remote control 
device which obtains a channel or television frequency 
selection from a user and controls the analog transmitter to 
transmit the analog wireless output signal at the television 55 
frequency or channel selected by the user. The control unit 
130 can also provide for selection from a number of different 
possible input sources and formats, and for selection from 
among one or more end devices. 

FIG. 2 is a flowchart of the process performed by the 60 
system shown in FIG. 1. In step 205, the system obtains a 
digital input signal. The digital input signal may be an 
integrated audio/video signal or a separate digital audio 
signal and digital video signal. If the digital input signal is 
determined in step 210 to be an integrated audio/video 65 
signal, the splitter 170 splits the signal in step 215 into a 
digital audio signal and a digital video signal. The digital 
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audio signal and digital video signal are then processed in 
step 220 by the audio circuit 120 and the video circuit 140, 
respectively. 

FIG. 3 is a flowchart of the process performed by the 
audio circuit 120 to process the digital audio signal in 
accordance with step 220. In step 305, the audio input 
interface 122 receives the digital audio signal and identifies 
an audio bitstream within the digital audio signal. The digital 
audio signal contains audio data from any of a number of 
possible sources. For example, the audio input interface 122 
can receive the digital audio signal from a network such as 
via the internet or an intranet. As another example, the audio 
input interface 122 can receive the digital audio signal from 
a local storage device, such as a CD-ROM, DVD or hard 
disk. As yet another example, the digital audio signal can be 
produced by a computer application such as a text-to-speech 
application or a digital musical instrument. 

One of ordinary skill in the art will readily implement the 
audio input interface 122 to receive a digital audio signal in 
any of a number of possible formats from any of a number 
of possible sources. The audio input interface 122 can be 
implemented, for example, using physical layer interface 
types such as USB, IEEE 1394-1995 and IEEE 802.x, and 
using protocols such as HTTP, TCP/IP, and UDP/IP. 
Depending on the source and format of the digital audio 
signal, the audio input interface 122 performs other func- 
tions in addition to identifying the audio bitstream. Such 
functions include, but are not necessarily limited to, physical 
layer functions such as error correction, etc., transport layer 
functions such as device addressing, etc., session layer 
functions such as content provider selection, and so forth. 

If the audio bitstream is determined in step 310 to have 
been digitally encrypted, the audio digital decryption unit 
123 digitally decrypts the audio bitstream in step 315. 
Possible applications of the invention described herein may 
require the digital audio signal to be digitally encrypted so 
that only authorized devices can use the audio content 
therein, such as premium channels, classified information, 
copy protection, and pay-per-listen content. The control unit 
130 controls the audio digital decryption unit 123 to decrypt 
only authorized digital audio. One of ordinary skill in the art 
will readily implement the audio digital decryption unit 123 
utilizing available hardware, software, and so forth. 

In step 320, the audio decoding unit 124 decodes the 
audio bitstream. One of ordinary skill in the art will imple- 
ment the audio decoding unit 124 based on the environment 
and application at hand, utilizing available hardware, 
software, etc. to decode the data based on any of a number 
of possible encoding methods with which the audio bit- 
stream has been encoded. Such encoding methods include, 
but are not limited to, ADPCM, CD-DA, ITU G.711,G.722, 
G.723 & G.728, MPEG 1,11 & III, AC-3, AIFF, AIFC, AU, 
Pure Voice, Real Audio and WAV. Depending on the encod- 
ing method, data compression may also be included, in 
which case step 320 includes the step of decompressing the 
audio bitstream and the audio decoding unit 124 includes a 
decompression component. 

In step 325, the audio digital to analog converter 126 
converts the audio bitstream to an analog audio signal. One 
of ordinary skill in the art will readily implement the audio 
digital to analog converter 126 utilizing an available digital 
to analog converter. If the analog audio signal is determined 
in step 330 to have been analog encrypted, then the audio 
analog decryption unit 127 decrypts the analog audio signal 
in step 335, Possible applications of the invention described 
herein require the analog audio signal to be analog encrypted 
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so that only authorized devices can use the analog audio or 
because the audio content is copy protected. The control unit 
130 controls the audio analog decryption unit 127 to decrypt 
only authorized digital audio. 

FIG. 4 is a flowchart of the process performed by the 5 
video circuit 140 to process the digital video signal in 
accordance with step 220. The process is essentially the 
same as that performed by the audio circuit 120 to process 
the digital audio signal. In step 405, the video input interface 

142 receives the digital video signal and identifies a video 10 
bitstream within the digital video signal. The digital video 
signal contains video data from any of a number of possible 
sources. For example, the video input interface 142 can 
receive the digital video signal from a network such as via 
the internet or an intranet. As another example, the video 15 
input interface 142 can receive the digital video signal from 

a local storage device, such as a CD-ROM, DVD or hard 
disk. As yet another example, the digital video signal can be 
produced by a digital video camera. 

One of ordinary skill in the art will readily implement the 20 
video input interface 142 to receive a digital video signal in 
any of a number of possible formats from any of a number 
of possible sources. The video input interface 142 can be 
implemented, for example, using physical layer interface 
types such as USB, IEEE 1394-1995 and IEEE 802.x, and 25 
using protocols such as HTTP, TCP/IP, and UDP/IP. 
Depending on the source and format of the digital video 
signal, the video input interface 142 performs other func- 
tions in addition to identifying the video bitstream. Such 
functions include, but are not necessarily limited to, physical 30 
layer functions such as error correction, etc., transport layer 
functions such as device addressing, etc., session layer 
functions such as content provider selection, and so forth. 

If the video bitstream is determined in step 410 to have 35 
been digitally encrypted, the video digital decryption unit 

143 digitally decrypts the video bitstream in step 415. 
Possible applications of the invention described herein may 
require the digital video signal to be digitally encrypted so 
that only authorized devices can use the video content 4Q 
therein, such as premium channels, classified information, 
copy protection, and pay-per-view content. The control unit 
130 controls the video digital decryption unit 143 to decrypt 
only authorized digital video. One of ordinary skill in the art 
will readily implement the video digital decryption unit 143 45 
utilizing available hardware, software, and so forth. 

In step 420, the video decoding unit 144 decodes the 
video bitstream. One of ordinary skill in the art will imple- 
ment the video decoding unit 144 based on the environment 
and application at hand, utilizing available hardware, 50 
software, etc. to decode the data based on any of a number 
of possible encoding methods with which the video bit- 
stream has been encoded. Such encoding methods include, 
but are not limited to, ITU H.261 & H.263, Motion JPEG, 
MPEG-1, MPEG-2 and MPEG-4, Cinepak, Clear Video, 5S 
Sony DV, Indeo, Real Video, Sorensen and VDOLive. 
Depending on the encoding method, data compression may 
also be included, in which case step 420 includes the step of 
decompressing the video bitstream and the video decoding 
unit 144 includes a decompression component. 60 

In step 425, the video digital to analog converter 146 
converts the video bitstream to an analog video signal. One 
of ordinary skill in the art will readily implement the video 
digital to analog converter 146 utilizing an available digital 
to analog converter. If the analog video signal is determined 65 
in step 430 to have been analog encrypted, then the video 
analog decryption unit 147 decrypts the analog video signal 
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in step 435. Possible applications of the invention described 
herein may require the analog video signal to be analog 
encrypted so that only authorized devices can use the analog 
video or because the video content is copy protected. The 
control unit 130 controls the video analog decryption unit 
147 to decrypt only authorized digital video. 

Returning now to FIG.2, upon processing the digital audio 
signal and digital video signal in step 220, the system 
outputs in step 225 the appropriate analog signal to the end 
device. FIG. 5 is a flowchart of this output process. The 
system determines in step 505 whether the end device is an 
analog wireline device 100 or an analog wireless device 110. 
If the end device is an analog wireline device 100, then the 
audio output interface 128 distributes in step 510 the analog 
audio signal and the video output interface 148 distributes 
the analog video signal to the analog wireline device 100 via 
wireline. One of ordinary skill in the art will readily imple- 
ment the audio output interface 128 and video output 
interface 148 utilizing available hardware, software, etc. to 
provide the appropriately formatted wireline signals, 
depending on the input format expected by the analog 
wireline device 100. For example, the audio output interface 
128 can distribute the analog audio signal to a cassette 
recorder, amplifier or amplified speakers using a standard 
line out connection. Similarly, the video output interface 148 
can distribute the analog video signal to a television or video 
cassette recorder using a standard Composite Video or 
S-Video connection. One of ordinary skill in the art will also 
readily extend the implementation to distribute the analog 
audio signal and/or analog video signal to multiple devices, 
as desired for the application at hand. 

If the end device is an analog wireless device 110, then the 
analog transmitter 150 mixes in step 515 the analog audio 
signal and the analog video signal to produce an analog 
wireless output signal and transmits in step 520 the analog 
wireless output signal to the analog wireless device 110. One 
of ordinary skill in the art will readily implement the analog 
transmitter to provide the appropriately formatted wireless 
signals, depending on the input format expected by the 
analog wireless device 110. For example, the analog trans- 
mitter 150 can transmit to a radio in a radio frequency in the 
AM or FM band, to a television in a television frequency or 
channel, or to wireless speakers and headphones in the 900 
Mhz frequency band. Alternatively, where the end device is 
a wireline device that receives a transmitted signal, such as 
a cable television, the analog transmitter 150 transmits an 
analog output signal to a wireline device instead of distrib- 
uting the analog audio signal and the analog video signal in 
step 510. One of ordinary skill in the art will also readily 
extend the implementation to transmit the analog audio 
signal, analog video signal or analog wireless output signal 
to multiple devices, as desired for the application at hand. 

It should be appreciated that the invention described 
herein provides the capability of playing digital audio and/or 
video with a device designed to receive a different form of 
input. The present invention has been described above with 
reference to preferred embodiments. However, those skilled 
in the art will recognize that changes and modifications may 
be made in these preferred embodiments without departing 
from the scope of the present invention. For example, one of 
ordinary skill in the art will recognize circumstances where 
the components of the audio circuit 120 and the video circuit 
140 may be differently arranged such that the functions 
performed thereby will be performed in a different order, as 
desired. Changes and modifications which are obvious to 
those skilled in the art are intended to be included within the 
scope of the present invention. 



12/22/2003, EAST Version: 1.4.1 



US 6,335 : 

7 

What is claimed is: 

1. A system for broadcasting audio content of a digital 
audio signal to an analog wireless device, comprising: 

an audio input interface receiving the digital audio signal 

and identifying an audio bitstream, wherein the audio 5 

bitstream comprises audio data based on a plurality of 

encoding methods; 
an audio decoding unit connected to the audio input 

interface and decoding the audio bitstream; 
an audio digital to analog converter connected to the 10 

audio decoding unit and converting the audio bitstream 

to an analog audio signal; and 
an analog transmitter connected to the audio digital to 

analog converter and transmitting the analog audio 5 

signal to the analog wireless device. 

2. The system of claim 1, further comprising an audio 
digital decryption unit connected to the audio input interface 
and decrypting the audio bitstream, 

3. The system of claim 1, further comprising an audio 2Q 
analog decryption unit connected to the audio digital to 
analog converter and decrypting the analog audio signal. 

4. The system of claim 1 wherein the analog transmitter 
transmits the analog audio signal to multiple devices. 

5. The system of claim 1 wherein the audio input interface 25 
receives the digital audio signal from a network. 

6. The system of claim 1 wherein the audio input interface 
receives the digital audio signal from a local storage device. 

7. The system of claim 1 wherein the audio input interface 
receives the digital audio signal produced by a text- to- 3Q 
speech application. 

8. The system of claim 1 wherein the audio input interface 
receives the digital audio signal produced by a digital 
musical instrument. 

9. A system for broadcasting video content of a digital 3S 
video signal to an analog wireless device, comprising: 

a video input interface receiving the digital video signal 
and identifying a video bitstream, wherein the video 
bitstream comprises video data based on a plurality of 
encoding methods; 40 

a video decoding unit connected to the video input 
interface and decoding the video bitstream; 

a video digital to analog converter connected to the video 
decoding unit and converting the video bitstream to an 
analog video signal; and 45 

an analog transmitter connected to the video digital to 
analog converter and transmitting the analog video 
signal to the analog wireless device. 

10. The system of claim 9, further comprising a video 
digital decryption unit connected to the video input interface 50 
and decrypting the video bitstream. 

11. The system of claim 9, further comprising a video 
analog decryption unit connected to the video digital to 
analog converter and decrypting the analog video signal. 

12. The system of claim 9 wherein the analog transmitter 55 
transmits the analog video signal to multiple devices. 

13. The system of claim 9 wherein the video input 
interface receives the digital video signal from a network. 

14. The system of claim 9 wherein the video input 
interface receives the digital video signal from a local 60 
storage device. 

15. The system of claim 9 wherein the video input 
interface receives the digital video signal produced by a 
digital video camera. 

16. A system for broadcasting audio and video content of 65 
a digital audio signal and a digital video signal to an analog 
wireless device, comprising: 
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an audio input interface receiving the digital audio signal 
and identifying an audio bitstream, wherein the audio 
bitstream comprises audio data based on a plurality of 
encoding methods; 

an audio decoding unit connected to the audio input 
interface and decoding the audio bitstream; 

an audio digital to analog converter connected to the 
audio decoding unit and converting the audio bitstream 
to an analog audio signal; 

a video input interface receiving the digital video signal 
and identifying a video bitstream, wherein the video 
bitstream comprises video data based on a plurality of 
encoding methods; 

a video decoding unit connected to the video input 
interface and decoding the video bitstream; 

a video digital to analog converter connected to the video 
decoding unit and converting the video bitstream to an 
analog video signal; and 

an analog transmitter connected to the audio digital to 
analog converter and connected to the video digital to 
analog converter, mixing the analog audio signal and 
the analog video signal to produce an analog wireless 
output signal, and transmitting the analog wireless 
output signal to the analog wireless device. 

17. The system of claim 16, further comprising a splitter 
receiving a digital input signal and splitting the digital input 
signal into the digital audio signal and the digital video 
signal. 

18. The system of claim 16 wherein the video input 
interface receives the digital video signal from a network. 

19. The system of claim 16 wherein the video input 
interface receives the digital video signal from a local 
storage device. 

20. The system of claim 16 wherein the video input 
interface receives the digital video signal produced by a 
digital video camera. 

21. A method for broadcasting audio content of a digital 
audio signal to an analog wireless device, comprising the 
steps of: 

receiving the digital audio signal and identifying an audio 
bitstream, wherein the audio bitstream comprises audio 
data based on a plurality of encoding methods; 

decoding the audio bitstream; 

converting the audio bitstream to an analog audio signal; 
and 

transmitting the analog audio signal to the analog wireless 
device. 

22. The of claim 21, further comprising the step of 
decrypting the audio bitstream. 

23. The method of claim 21, further comprising the step 
of decrypting the analog audio signal. 

24. The method of claim 21 wherein the step of decoding 
the audio bitstream includes decompressing the audio bit- 
stream. 

25. A method for broadcasting video content of a digital 
video signal to an analog wireless device, comprising the 
steps of: 

receiving the digital video signal and identifying a video 
bitstream, wherein the video bitstream comprises video 
data based on a plurality of encoding methods; 

decoding the video bitstream; 

converting the video bitstream to an analog video signal; 
and 
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transmitting the analog video signal to the analog wireless 
device. 

26. The method of claim 25, further comprising the step 
of decrypting the video bitstream. 

27. The method of claim 25, further comprising the step 5 
of decrypting the analog video signal. 

28. The method of claim 25 wherein the step of decoding 
the video bitstream includes decompressing the video bit- 
stream. 

29. A method for broadcasting audio and video content of to 
a digital audio signal and a digital video signal to an analog 
wireless device, comprising the steps of: 

receiving the digital audio signal and identifying an audio 
bitstream, wherein the audio bitstream comprises audio 
data based on a plurality of encoding methods; 15 

decoding the audio bitstream; 

converting the audio bitstream to an analog audio signal; 
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receiving the digital video signal and identifying a video 
bitstream, wherein the video bitstream comprises video 
data based on a plurality of encoding methods; 

decoding the video bitstream; 

converting the video bitstream to an analog video signal; 
mixing the analog audio signal and the analog video 

signal to produce an analog wireless output signal; and 
transmitting the analog wireless output signal to the 

analog wireless device. 
30. The method of claim 29, further comprising the steps 
of: 

receiving a digital input signal as an integrated digital 

input signal; and 
splitting the digital input signal into the digital audio 

signal and the digital video signal. 

***** 
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ABSTRACT 



A printed illustrated text, printed alphabetical text and 
printed illustrated index are all correlated to a set of 
recordings intended for audio visual display and which 
are in turn topically arranged. In addition the illustrated 
index may by themselves be recorded in their entireties 
for audio visual display. The illustrated text is presented 
by a main written portion heavily pictorialized by a key 
illustration and ancillary illustrations arranged in a pre- 
determined sequence with ancillary supporting infor- 
mation. A conspicuously displaying cross-reference 
listing refers to other pertinent illustrated texts and 
topical audio visual recordings. The alphabetical text is 
correlated to pertinent portions of the illustrated text by 
having, on pertinent pages thereof, key illustrations 
from the illustrated text. It, in addition, carries cross-ref- 
erences to pertinent optical audio visual recordings as 
well as to other pertinent information in the system. The 
illustrated index, which may include reduced reproduc- 
tions of entire pages from the illustrated text, is also 
cross-referenced to pertinent topical audio visual re- 
cordings. The jackets for each topical audio visual re- 
cording include a printed display of pertinent portions 
of the illustrated text and pertinent portions from the 
alphabetical text. In addition sub-topic titles, and/or 
illustrations indicative of such sub-topics, are arranged 
in positions corresponding to the position of the re- 
corded sub-topic information; and are printed either 
directly upon the audio visual recording or a transpar- 
ent sleeve carried by the jacket. 

26 Claims, 9 Drawing Figures 
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encyclopedia type reference texts are recorded in their 
AUDIO VISUAL INFORMATION SYSTEM entirety for audio visual presentation. 

It is yet still a further object of this invention to pro- 
Matter enclosed In heavy brackets [ J appears in the vide a novel and improved jacket for housing an audio 
original patent but forms no part of this reissue specifics- 5 visual recording. 

tion; matter printed in italics indicates the additions made [ t is yet still a further object of this invention to pro- 
by reissue* vide a novel and improved audio visual recording 

jacket wherein information corresponding to the re- 
BACKGROUND OF THE INVENTION - FIELD catted information is printed by words and illustrations 
OF APPLICATION 10 upon ^ jackct . 

This invention relates to an information system, and It is yet still a further object of this invention to pro- 
more particularly to a system for arranging indexing vide a novel and improved audio visual recording, 
and cross-referencing information pictorially and by It is yet still a further object of this invention to pro- 
words for audio visual presentation. vide a novel and improved manner of correlating sub- 

r%n,rvrrTAxt topic information on an audio visual recording to the 

""sss^sKsssr • rf-- - *< *~«^ — * — * 

information is recorded. 

The quest for information, or research as it is more |„ carrying out the invention, according to the pre- 

formaJly called, is carried on in many ways. One may go fccttA embodiment, there is provided an information 

to texts, magazine articles, newspapers or like material svs tem utilizing audio visual recording for topical pre- 

when pursuing information about a particular topic. No section of alphabetically arranged expanded entry 

such research is considered to be complete without type descriptions and comprehensive heavily illustrated 

looking up the subject in an encyclopedia type refer- encyc lopedia type reference material; and. in fact, for 

ence text. In fact, a great deal of such research, espe- presentation of entire texts of such expanded dictionary 

daily by students in various grades of school and even » definitions and encyclopedia arranged information, 

college, both begins and ends with the «cyctoped*. ^.^rencing of & topical audio visual recordings 

JS P ^^"^^^ tt£S2£££tt texts provides for 8 

research material is almost invariably only available in description of the preferred embodiment when consid- 

printed form. ered in conjunction with the drawing and from the 

More often than not a number of students are as- 35 appended claims, 
signed the identical topic to research. But encyclopedia BRIEF DESCRIPTION OF THE DRAWING 
type research texts are expensive and only a few librar- 
ies can afford more than one set of a particular encyclo- In the drawing: 

pedia. Thus each student must wait their turn. Some FIG. 1 is a specimen layout from an illustrated corn- 
may even find it impossible to get a time to review the 40 prehensive text showing the relationship between the 
encyclopedia and may have to do without this invalu- elements thereof which incorporate the instant system; 
able source of information, FIG. 2 is a specimen layout of a page from an illus- 
When describing to a group how to use an encyclope- trated alphabetical text showing the relationship be- 
dia; or when presenting the results of research from an tween the elements thereof which incorporate the in- 
encyclopedia to a group, one can either hold up the text 43 si&ni invention; 

for the group to view or pass the text around for better p IG 3 ^ a specimen layout of a page from an illus- 

understanding. If equipped with a projector the perti- trated comprehensive index showing the relationship 

nent encyclopedia pages may be shown on a screen. But between the elements thereof which incorporate the 

all of the above make for difficult presentations, may faxant invention; 

subject the text pages to tearing, marking or other dam- 50 pj G 4 ^ a ^^,^0 showing of a topical informa- 

age and require an articulate speaker if an interesting tfon whicn houses an audio visual recording of a 

and understandable presentation is to be made. topic corresponding to one of the topics which appear 

SUMMARY OF THE INVENTION in the illustrated comprehensive text of the type which 

_ . . . . * j « would be displayed on a page as shown in FIG. 1 and 

It is therefore an object of this invention to provide a 55 which m ate the instant mven tion; 

novel and improved information system. schematic showing of a form of sleeve 

It is another object of this invention to provide a from the information jacket of FIG. 4 which houses and 

novel and mproved audio visual information system. irum ^ . ^ ■ . 

It is a further object of this invention to provide a Protects the recording and which tncorporates the in. 

novel and improved ( system for storing topical informa- 60 ^^^^ form of mfon nation recording 
U Tt to provide a for use with the information jacket of FIG. 4 and which 

novel and improved information system wherein topical mcorporates the instant mvention; 
information prepared for audio visual presentation is FIG. 7 is a specimen layout of the back of the infor- 
cross-referenced with like alphabetically and topically 65 mation jacket of FIG. 4; 

arranged printed information. FIG. 8 is a schematic layout of a playback system for 

It is yet still a further object of this invention to pro- utilizing the audio visual recording of the instant inven- 
vide a novel and improved information system wherein tion; and 
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FIG. 9 is a schematic frame by frame layout of a 
typical topical audio visual recording as same might be 
displayed by a system such as shown in FIG. 8. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

For convenience the invention will be described as 
applied to an information system including a plurality of 
audio visual recordings each in the form of a disc 
adapted for optical scanning and playback through a 
home type television set, and wherein the audio visual 
recordings are of selected topics from an encyclopedia 
type text heavily illustrated in color and with insertions 
from an alphabetical text of expanded entry type de- 
scriptions. A jacket for housing each such optical audio 
visual recording is provided on its back page with 
printed reproductions of part of all of the comprehen- 
sive text article and with one or more pertinent alpha* 
betical text descriptions and carries a sleeve for the 
recording with either the sleeve or the recording itself 
printed with sub-topic titles .or illustrations at positions 
indicative of the recorded positions corresponding to 
sub-topic. It should be understood, nevertheless, that 
without departing from the scope of the invention that 
subject information system may be recorded on tape or 
other suitable non-disc forms, may be played back 
through non-optional scanning and by closed circuit 
and/or other suitable television type presentation 
means; that the recorded information may be not only 
topical but also the entire comprehensive illustrated text 
and alphabetical illustrated text with their respective 
indexes or for that matter, the text of any dictionary, 
encyclopedia or other reference work; that the jacket 
for housing the recording may have the information 
printed on any portion thereof or not at all; and that 
other suitable means may be provided for indicating 
where in the recording a sub-topic begins if such be 
desired at all. 

With reference to FIG. 1 there is generally shown at 
10 a specimen page from a comprehensive illustrated 
text as described in our co-pending application entitled 
"System for Arranging and Retrieving Information" 
and which was filed on Sept. 25, 1975 as application Ser. 
No. 616,865. In that application each such page, or 
group of pages, forming the comprehensive illustrated 
text is described as including, under a subject heading 
12 a main word text 14 and a set of color illustrations 16 
including a key illustration 18 and ancillary illustrations 
20 accompanied by ancillary text 22, and often consecu- 
tively numbered to facilitate the flow thereof in an 
orderly manner. 

A cross-reference listing 24 is conspicuously dis- 
played in a marginal position on each such layout 10. 

Also described in my above mentioned application is 
an illustrated alphabetically arranged text 40 (FIG. 2) 
including a plurality of alphabetically arranged ex- 
panded short entry type word descriptions 42, arranged 
in a particular portion of the page; accompanied by a 
number of reproductions of the key illustrations 44 from 
the comprehensive illustrated text 10 also displayed in a 
particular portion of the printed page. The alphabetical 
text is described in said application as including cross* 
reference information to the comprehensive illustrated 
text as part of the captions 46 to said reproductions 44 of 
said key illustrations and as part of the printed text 42 as 
shown at 48. 

An illustrated comprehensive index 50 (FIG. 3) is 
additionally described in my aforementioned co-pend- 



20 



ing application. Index 50 is described as including re- 
duced size reproductions 52 of full text pages from the 
comprehensive illustrated text 10 adjacent to which 
appear columns 54, 56, 58 and 60 respectively of cross- 
5 referencing to other information both within and out- 
side of the information system. It will be appreciated 
that the index may be located at any place in the illus- 
trated aliphabetical text or the illustrated comprehen- 
sive taxt or in a volume by itself If the index appears at 
10 the front of a volume, it may be referred to as a table of 
contents or other suitable term. 

To accompany, compliment and supplement the 
aforementioned "System For Arranging and Retrieving 
Information" there are provided a number of topical 
15 video visual recordings such as the one illustrated at 70 
in FIG. 4. Recording 70 is shown as housed in a sleeve 
72 carried by a jacket 74 having a front cover 76, and a 
rear cover 78 connected to a spine 80. 

While each such recording 70 is herein described as 
for a single topic corresponding to a topic from the 
comprehensive illustrated text 10; it should be realized 
that space requirements for properly covering the topic 
may dictate the use of multiple recording 70 for a single 
topic. In the alternative a single recording 70 may cover 
more than one such topic if the topic content so permits. 

Also contemplated by the instant system is a single 
recording 70, or multiple recordings 70, which encom- 
pass the entire illustrated comprehensive text 10, illus- 
trated alphabetical text 40 and illustrated comprehen- 
sive index 50. 

Recording 70 is shown as a disc but it should be real- 
ized that tape or other suitable recording means may 
just as easily be utilized. 
33 In FIG. 5 sleeve 72 is shown removed from jacket 74 
but with a recording disc 70 still disposed therein. 
Sleeve 72 is preferably of transparent material such as 
plastic or the like; but other suitable materials may be 
used. Printed upon the surface 82 of sleeve 72 are sub- 
40 topic titles 84, 86, 88, 90 and 92 which correspond to 
sub-topics of the topic recorded in audio visual manner 
upon recording 70. Titles 84, 86, 88, 90 and 92 are also 
positioned upon surface 82 in alignment to the position 
on recording 70 where the sub-topic information is 
43 recorded. Also, the frame numbers themselves may be 
printed on the sleeve. In this manner the user may easily 
position the playback equipment for recording 70 so as 
to begin at a particular sub-topic instead of having to 
either start at the beginning of recording 70 and play 
50 everything until the desired sub-topic appears, or 
merely guessing hit or miss until the user finds the place 
desired to start. 

Alternatively recording 70 may have printed directly 
upon its recorded surface references to such sub-topics 
55 and/or frame numbers. This appears for a recording 70a 
as shown in FIG. 6 wherein the surface 96 of recording 
70a has reproductions of the illustrations 18, 20 from the 
comprehensive text 10 printed thereon at 98, 100, 102 
and 104. Here again the illustrations are positioned to 
60 correspond to the position of recording of their respec- 
tive sup-topic or frame. 

Printed titles such as 84, 86, 88, 90 and 92 may accom- 
pany or be substituted for illustrations 98, 100, 102, 104 
of FIG. 6; while illustrations such as 98, 100, 102 and 
65 104 may accompany or be substituted for the titles 84, 
86, 88, 90 and 92 of FIG. 5. The important object is to 
provide some form of index to direct the user to a se- 
lected recorded area of recording 70. 
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Jacket 74 may have displayed, as by printing, upon A typical frame by frame arrangement for a topical 

the facing page of front cover 76 information 120 (FIG. recording 70 is schematically illustrated in FIG. 9 

4) including words and illustrations, indicative of the wherein a strip 200 is shown beginning with frame 202 

topic or topics recorded upon recording 70 housed and proceeding consecutively through frame 204, 206, 

therewithin. A title 122 may likewise appear upon spine 5 208, 210, etc to 2nn. 

80. Frame 202 would carry the title for recording 70 

On the facing page of back cover 78 of jacket 74 there corresponding to the topic recorded theron, Frame 206 

is reproduced, as by printing or other suitable means, at and 208 would display reproductions of the entire pages 

126 a copy of the pages of the comprehensive illustrated from the comprehensive illustrated text (as described 

text (such as shown at 10 in FIG. 1) corresponding to 10 with reference to FIG. 1) and reproductions of perti- 

the topic of recording 70. Also reproduced on back *ent expanded word descriptions from the illustrated 

cover78asat 128 is a copy of pertinent alphabetical text alphabetical text (as described with reference to FIG. 

descriptions compiled from the illustrated alphabetical 2 )' . „ _ _ _ 

text as described for FIG. 2. Thereafter in frames 210, 212, 214, etc. the entire 

Each topical recorcing 70 is in turn cross-referenced 15 t0 P lc would f covcrcd by sub-topic and where perti- 

into the comprehensive illustrated text, as described for °f nt reference to sections of the comprehensive 

FIG. 1. and will appear therein either in the cross-refer- illustrated text and expanded word descriptions^ 

ence listing 24 or at a position 140 closely adjacent 1 As previously set forth it.s an inherent capability of 

thereto and so as to be conspicuous. P la >: back 150 to bc able to present the infor- 

<SS^ng of the availability of a topical re- 20 mat ™ ™ orded f recording 70 e.ther in a ccntmu- 

cording 70 will alsS appear in the illustrated alphabet*. ^^^Ttll tT^Z'ZiTtt 171 Z 

, , f . j c •% e -u ~. • „ a desired period of time (or a few frames at a time so 

cal text, as described For FIG. 2. Such c»^«w»ag (hat thc fr £ c t0 ^ frozcn) „ by thc 

may accompany the illustrations appearing at 44 by ^ Accordingly when information is recorded 

inclusion in captions 46 or adjacent or prolate u ^ n recordin£ 7 0 a suitable number of frames t 202-210 

thereto- They may appear also or additionally as part of £ mm% ^ for ^ { tQ maintain ^ 

the cross-referencing 48 within texts 42. on ^ yicwi &crccn j e h tQ ^ $ccn ^ $tud . 

To make the system even more comprehensive cross- M when the layback equipment 150 is in a continuous 
referencing to audio visual recordings 70 also are in- mode of atiorlt is accomplished by conven- 
serted with the columnar material 54, 56, 58, 60 of the ^ , iona| tcchniques well known in the fie | d . 
comprehensive illustrated index described with refer- ^ thc othcf handf wriUen ^ even pictoria ] 
ence to FIG. 3, Such cross-referencing may appear ^formation is inserted on recording 70 to be seen only 
within one of the columns 54, 56, 58, 60 or may appear in a framc by frame frccM modc of operation for play- 
as an additional column or m any other conspicuous back equipment 150. This is accomplished by recording 
manner. 35 such information on only a single frame, 202-210 etc. 

The audio visual information recorded upon record- wheil recording 70 is played in a continuous man- 

ing 70 may be presented to one or more observers on ncr thc framc ^ recorded will flash upon the viewing 

playback equipment 150 such as that shown in FIG. 8. screen; but only for such a short period of time that its 

Equipment 150 is of the type conventionally available persistency will be too short to allow viewing thereof, 

to the public and more commonly known as "Philips 40 i n fat, the viewer will not even be aware that it ap- 

and MCA Videodisc System". In the schematic of FIG. peared, except maybe subliminally. When it is desired to 

8, recording 70 is placed upon videodisc player 152 yi ew trie s i n ^i e frame one need only run playback 

which is in turn driven by a motor 154 powered from a equipment 150 continuously until the frame approaches 

suitable source and controlled in conventional manner then frame by frame until the information appears 

by suitable switches. A laser 156, powered from a sup- 45 on t he screen. 

ply 158 co-operates with optics 160, a mirror 162 and an From the above description it will thus be seen that a 
objective 164 to transmit successive portions of record- novel and improved audio visual information system 
ing 70 through a light sensitive device 166 to video and has been provided; which system provides for record- 
servo electronics 168 which in turn control and present m g f or audio visual presentation of expanded word 
the recorded information upon a conventional home 50 entry type descriptions information, and comprehensive 
TV set 170. illustrated encyclopedia type text information and the 

The recorded information is thereby presented sue- corresponding cross-referencing in a conspicuous man- 

cessively in frame by frame manner upon the screen of n er into said word entry test and encyclopedia text of 

set 170. Suitable controls are provided for equipment the availability of said audio visual information. 

150 to advance same or back same up to any selected 55 it is understood that although we have shown the 

position and to freeze any display upon the screen of set preferred form of my invention that various modifica- 

170. tions may be made in the details thereof without depart- 

It should be understood that other suitable playback ing from the spirit as comprehended by the following 

equipment may be utilized; such as the RCA "Selec- claims. 

traVision Videodisc system" and that closed circuit as 60 We claim: 

well as other suitable television presentation equipment 1. An audio visual information system comprising: 

may be used to view the recorded information. (a) first information means consisting of a plurality of 

When preparing recording 70, if desired, appropriate graphic displays each concerning a particular se- 

musical and other sound effect background may be lected topic; 

recorded into recording 70 by conventionally available 65 (b) each of said graphic displays including a main 

techniques. In a similar manner a voice over reading or word text and a pictorial ized description each suffi- 

description of the text material may be provided to cient to describe its particular selected subject 

further enhance the understanding thereof. without reference to the other and each disposed in 
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a separate and distinct location within its graphic 
display; 

(c) each pictorialized description including a key 
illustration and a plurality of ancillary illustrations 
arranged in a sequence, the key illustrations of said 
plurality of graphic displays being sequenced. 

(d) second information means constituting a graphic 
arrangement of alphabetically set out expanded 
word descriptions of a plurality of selected topics 
and a reproduction of selected key illustrations 
from said graphic displays of said first information 
means when such key illustrations pertain to said 
topics and said key illustrations being in correlation 
to the alphabetical arrangement of said word de- 
scriptions; and 

(e) third information means constituting a recording 
for audio visual playback including audio visual 
display of a selected topic from said first informa- 
tion means and including at least a key illustration 
related to said topic, said recording being provided 
with index means for locating said topic, whereby 
the user of the system may retrieve the information 
of the above information means without substantial 
resort to text material. 

2. The audio visual information system of claim 1 
including: 

(f) fourth information means constituting a graphic 
index including reproductions of said key illustra- 
tions of said first information means, and said key 
illustrations being arranged according to (c) or (d) 
with each such key illustration disposed adjacent a 
listing of selected types of information related to its 
particular topic. 

3. The audio visual information system of claim 2 
wherein said first information means, said second infor- 
mation means and said fourth information means are 
recorded for audio visual playback. 

4. The audio visual information system of claim 2 
wherein additional information not forming part of said 
first, second or fourth information means is recorded on 
said third information means recordings. 

5. The audio visual information system of claim 1 
wherein said third information means includes pertinent 
graphic arrangements of word descriptions from said 
second information means. 

6. The audio visual information system of claim 5 
wherein said graphic displays of said first information 
means included in said fourth information means being 
reduced in size when compared to said graphic displays 
as reproduced for said first information means. 

7. The audio visual information system of claim 1 
wherein said key illustrations when reproduced for said 
second information means being grouped together sepa- 
rate from said word definitions at a selected location in 
said graphic arrangement and being reduced in size 
when compared to the size therefore as displayed in said 
first information means. 

8. The audio visual information system of claim 1 
wherein said recording of said fourth information 
means is provided with sound. 

9. The audio visual information system of claim 8 
wherein said sound is background music, sound related 
to the subject matter to be displayed and voice over 
describing the information to be displayed. 

10. The audio visual information system of claim 1 
including: 

record storing means in the form of a jacket for re- 
ceiving and storing said recording and upon which, 



in addition to indicia for indicating the topic re- 
corded upon the record, there is displayed text as 
recorded in the reference work. 

11. The audio visual information system of claim 10 
5 wherein said jacket also has displayed thereon ex- 
panded word descriptions related to the recorded topic. 

12. The audio visual information system of claim 10 
wherein said jacket includes a sleeve within which the 
record is stored. 

1° 13. The audio visual information system of claim 12 
wherein said sleeve is formed from transparent material. 

14. The audio visual information system of claim 12 
wherein said sleeve has displayed thereon indicia indic- 
ative of sub-topics recorded on said recording and 

15 wherein said indicia are positionally located on a sur- 
face of said sleeve so that when said record is stored 
thereon the indicia is disposed in alignment with the 
corresponding information as recorded on said record 
means. 

15. The audio visual information system of claim 14 
wherein said indicia are words defining the sub-topic 
title. 

16. The audio visual information system of claim 15 
wherein said indicia are graphic pictorial illustrations 
indicative of the sub-topic information. 

17. The audio visual information system of claim 14 
wherein said indicia are frame designations. 

18. The audio visual information system of claim 1 
wherein said recording is in the form of a disc. 

19. The audio visual information system of claim 1 
wherein said recording is recorded for optical sensing 
and playback. 

20. The audio visual information system of claim 1 
33 wherein said recording has displayed thereon indicia 

indicative of sub-topics recorded on said record means 
and wherein said indicia are positionally located on said 
record means in positions corresponding to the loca- 
tions where the sub-topic information is recorded. 
4Q 21. The audio visual information system of claim 20 
wherein said indicia are words defining the sub-topic 
title. 

22. The audio visual information system of claim 20 
wherein said indicia are graphic pictorial illustrations 

45 indicative of the sub-topic information. 

23. The audio visual information system of claim 1 
wherein 

(a) at least some of said information is recorded upon 
said recording for continuous viewing; and 
50 (b) some other of said information being recorded 
upon said recording for frame by frame viewing; 
(c) said other of said information being recorded on 
said recording on at least one frame so that in a 
continuous viewing of said recorded information 
55 the lack of many multiple frames of the other infer - 
• mation inhibits viewing thereof. 

24. The audio visual information system of claim 23 
wherein said at least one frame is a single frame. 

25. An audio visual information system comprising: 

60 a. first information means comprising pictorial informa- 
tion concerning a particular selected topic; 
b. second information means comprising first text infor- 
mation means comprising pages of illustrated text and 
word descriptions relating to said selected topic, and 

65 second text information means comprising compre- 
hensive sub topic information covering said topic and 
reference to pages of the illustrated text and said 
descriptions; 
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c recording means comprising a recording for audio 
visual playback including audio visual display of said 
pictorial and text information: wherein 

d. part of said pictorial information being recorded upon 
said recording means for continuous viewing; 5 

e. said first and second text information means being 
recorded upon said recording means for frame by 
frame viewing; and 

f said first and second text information being recorded 
on said recording means on at least one frame so that 10 
in a continuous viewing of said pictorial information 
the lack of many multiple frames of the text informa- 



tion inhibits viewing thereof whereby the user may 
stop the continuous viewing of the topical pictorial 
information to study the first text information means 
relative to the topical information and then selectively 
study the comprehensive sub topic informtion with 
reference to related sections of said illustrated text. 
26. The audio visual information system of claim 25, 
wherein some of said pictoral information is recorded upon 
said recording means for continuous view and other of said 
pictoral information is recorded on said recording means 
for frame by frame viewing. 
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path is determined. If any one alternative path is available, 
this is included in the determination of network availability. 
Further, a relative weight may be assigned to various 
devices/paths on the network depending on usage or other 
parameters. The availability information is then presented in 
the format of a report card where specific source/destination 
pairs and the paths therebetween are chosen as indicia of the 
network's availability, 
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SYSTEM FOR DETERMINING NETWORK 
CONNECTION AVAILABILITY BETWEEN 
SOURCE AND DESTINATION DEVICES FOR 
SPECIFIED TIME PERIOD 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention is directed to the management of 
computer networks, and more specifically to a method and 
system for determining availability of devices and paths 
within a computer network in order to determine and report 
on availability of the network. 

2. Description of Related Art 

Businesses and academic organizations throughout the 
world are now highly dependent on the operation of their 
computer networks and they make large investments of time 
and money in setting up and maintaining the same. MIS 
directors and system administrators work with and need to 
know and understand the workings of these networks, and in 
particular, need to be able to determine network 
"availability," i.e., if the network has been available to its 
users and if the network has been running efficiently. In 
doing so, it must be determined what measurements can be 
used to establish whether the network has been available. It 
is also necessary to keep track of the unavailability of the 
network to determine how much time has been lost because 
employees were prevented from doing their jobs. Finally, 
those components which impact network availability must 
be identified and their problems addressed. 

In the past, network availability has been defined in 
different ways depending upon the focus of those persons 
doing the measuring and recording. For example, one pur- 
pose of availability measurement is to provide an early 
warning of a potential disaster, in which case network 
availability is defined as a ratio between MTBF (Mean Time 
Between Failures) and total time, where the total time equals 
MTBF plus MTTR (Mean Time To Repair). 

In a communications network, device availability may be 
denned as a ratio between the time the device was available 
and a total time under evaluation. In this case, no consid- 
eration is given to the users and/or the functions of these 
devices where, for example, a wide- area link between two 
sites is inoperative and has no effect unless the users from 
one site are trying to access a facility on the other site. In 
other words, there may be instances where a device is 
inoperative, but has little or no impact on network operations 
because it is not being used or is lightly used. 

It has been suggested that the availability of devices that 
are connected to each other can be aggregated, i.e., the 
aggregate is a product of all the availabilities of all devices 
in a particular path. This approach, however, has two flaws 
when applied to historic data. Firstly, when considering a 
single path between two devices, the resulting calculation 
will provide the most pessimistic number for the availability 
of the path and not the actual one. Using the most pessimistic 
number may mislead network managers about the actual 
functional availability of their networks. This inaccuracy 
results because the method does not account for any over- 
lapping of down times of the devices under consideration. 
Secondly, the proposed approach fails to address a situation 
where there are multiple paths between devices in the 
communications network. 

As a result, a system and method are necessary for 
providing a representation of network availability that is 
more comprehensive and realistic than known methods and 
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which accounts for overlap between device down times or 
path down times when aggregating the availabilities for a 
network link. Further, a system is needed which takes into 
account network topology and any changes thereto. 

s 

SUMMARY OF INVENTION 

According to the present invention, a method and system 
are provided which determine network availability by taking 
into account the network topology and the changes thereto. 
10 The present invention provides an accurate measurement of 
the availability of a destination device with respect to a 
source device by looking at all possible paths between the 
two devices. This, therefore, means that if a primary path 
and a redundant path are available between a source device 
and a destination device, any failure of the primary path will 
not impact network availability measurement if the network 
remains available via the redundant path. Further, the 
present invention accounts for an overlap of the unavail- 
ability of individual devices in a path so that unavailability 
is characterized more as a function of the path as opposed to 
the individual unavailabilities of the devices on the path. 
This last aspect, therefore, provides useful information about 
overall network availability, rather than the availability of 
isolated devices. 

25 

Specific paths between devices in the network are iden- 
tified and used to characterize the network's availability. 
This information is then presented in the form of a report 
card. The report card can be customized to show specific 

30 network attributes and can be automatically generated on a 
scheduled basis. 

These and other features and benefits of the present 
invention will be set forth in the following detailed descrip- 
tion and drawings which are given by way of example only 

35 and are in no way restrictive. 

BRIEF DESCRIPTION OF FIGURES 

FIG. 1 is a schematic representation of a network; 
40 FIG. 2 is a schematic diagram of one embodiment of the 
present invention; 

FIG. 3 is a schematic representation of a topology of a 
path in a network; 

FIG. 4 is a flowchart of a first method according to a first 
45 embodiment of the present invention; 

FIGS. 5a, 5b, 5c, 5d, 5e, 5/, Sg, and 5/i, are timelines 
showing availability of devices in the topological path as 
found in FIG. 3; 

FIG. 6 is a flowchart of a second method according to a 
50 second embodiment of the present invention; 

FIG. 7 is a block diagram of functional layers of a system 
according to the present invention; and 
FIGS. 8, 9, and 10 are sample network availability reports 
55 as generated according to the present invention. 

DETAILED DESCRIPTION 

In order to measure the effectiveness of a computer 
network, the availability of each device on the network is 

60 generally determined. In the present invention, however, 
network availability is defined as the availability of useful 
devices and accessability to useful devices from the per- 
spective of users of these devices. A weighted measure of 
availability of a device is defined as a product of the device's 

65 availability and its relative importance with respect to other 
network devices where, for example, a more useful device, 
such as a router, being unavailable will have a greater impact 
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on network operations than a relatively scarcely used work- 
station. Further, point-to-point availability in a network 
between a source device and a destination device is an 
aggregate of the availabilities of all of the devices present on 
all possible paths between the source and the destination, 
taking into account non -ope rational overlap as described 
hereinafter. 

The present invention focuses on useful devices and 
defines the availability of these useful devices in terms of 
point-to-point availability of the useful devices and their 
users. This method allows network managers to concentrate 
on real problems, rather then working with aggregations of 
the up times and down times (percentages) of all of the 
network devices whether or not they are "useful." As a 
result, "more important" devices, e.g., routers or servers, can 
be distinguished from "less important" devices, such as a 
workstation. The relative importance of the devices can be 
defined by several pre-selected or user-defined 
characteristics, e.g., volume of traffic (messages) through the 
device, or simply by a device characteristic, such as being a 
router or a server. The point-to-point availability measure- 
ment allows network managers to provide a more realistic 
view of the effect of unavailability of certain devices, in 
terms of the number of "affected users" who try to access the 
network through the unavailable device or devices. 

As shown in FIG. 1, a network 100 may include a 
plurality of workstations 102 connected to one another via a 
local area network (LAN). Here, a first set 104 of worksta- 
tions 102 are connected to a LAN 106, and a second set 108 
of workstations 102 are connected to a second LAN 110. The 
LANs 106, 110 are each coupled to a repeater 112 which is 
connected to a hub 114. At what may be characterized as a 
highest level of the network 100, a router 116 is connected 
to the hub 114. As is well known, other combinations of 
hubs, repeaters, LANs and workstations may be connected 
to the router 116 and the hub 114 depending upon the size 
of a given network. 

Many commercial network management applications are 
available. These include Spectrum® Network Manager, 
available from Cabletron Systems, Inc., Rochester, N.H., 
U.S.A. Operation of this network manager is described in 
U.S. Pat. No. 5,504,921 issued to Roger Dev et al., which is 
hereby incorporated by reference in its entirety. 

The present invention uses the topology of the network 
for its determination of network availability and therefore 
runs in conjunction with a known tool for discovering the 
topology of a network. Many such tools are commercially 
available, such as those available from Cabletron Systems, 
Inc. and described in currently pending and commonly 
owned U.S. Pat. No. 5,727,157 issued on Mar. 10, 1999 by 
T. Orr et al., which is hereby incorporated by reference in its 
entirety. 

In regard to topology determination, and as shown in FIG. 
2, the network 100 is coupled to a discovery tool 200 which 
determines the topology of the network. The determined 
topology is delivered to a processor 202 which is coupled to 
a memory 204, storage device 206, an input device 
(keyboard) 208 and a display device 210. The discovery tool 
200 will regularly poll the network 100 and from the results 
of this polling determine the topology of the network at a 
given point in time. This information is delivered to the 
processor 202 which organizes the information and stores it 
in the storage device 206 for later use. In addition, the 
information may be displayed concurrently on the display 
210 and an operator may gather more information by 
submitting appropriate commands through the keyboard 
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208. The processor 202 can run on various hardware plat- 
forms including, but not limited to: a SunSparc 5, 10 or 20 
processor running the SunOS or Solaris operating system; 
and an Intel x86 (or i960) processor running Windows 3.1, 
Windows '95, or Windows NT (or an embedded operating 
system in the case of the i960). 

A user may wish to determine the historical availability of 
a network, between a source and a destination, over a 
previous time period. As an example, reference is made to 
FIG. 3, which shows a representation of all paths between a 
source (S) device 300 and a destination (D) device 302. As 
can be seen, there are two possible paths between the source 
300 and the destination 302. One path includes device (A) 
304 and device (B) 306, while a second path includes device 
(A) 304 and device (C) 308. The first path may be referred 
to as S-A-B-D, and the second path as S-A-C-D. 

The point-to-point or link availability determines the 
historic link availability between the source 300 and the 
destination 302. As can be seen in the example of FIG. 3, 
multiple paths are available. The connection between the 
source 300 and the destination 302 is, therefore, considered 
available when any one of the possible paths is available at 
any moment in time during the time period of interest. 
According to the present invention, a determination of any 
overlap of unavailability between the devices and the paths 
is made. An advantage of the present invention is that the 
availability of the network is measured from the point of 
view of the user. Specifically, the source and destination 
devices are included in the calculation since these are 
devices which, from the perspective of a user, effect the 
network's availability. In other words, if a user attempts to 
access the network and his workstation is not functioning, 
then as far as that particular user is concerned the network 
is unavailable. The present invention polls the status of all 
devices, including the end stations, e.g., a user workstation, 
to determine when each device is operational and non- 
operational. One may see, however, that if a user is in the 
habit of shutting off a workstation at the end of the workday 
that this may artificially lower a network's availability 
result. The present invention includes the capability to 
measure network availability over a specific period of time, 
e.g., normal workday hours, so as not to be artificially 
impacted by such procedures as shutting off workstations 
when the workday is done. 

A determination of the point-to-point availability of the 
network, between the source 300 and the destination 302, 
will now be described in conjunction with the flowchart 
shown in FIG. 4. In step 402, the source device and 
destination device are established, and in step 404 the time 
period under consideration ("sample time period") is deter- 
mined. This can be chosen by a user through the keyboard 
208 or automatically scheduled, as discussed further below. 
The network topology is analyzed and all possible routes, 
and the devices thereon, between the source and destination 
devices which existed during the sample time period are 
found in step 406. As per the example of FIG. 3, these would 
be the paths S-A-B-D and S-A-C-D. In step 408, one route 
is chosen for analysis. All devices on the chosen route are 
then identified in step 410. Subsequently, in step 412, one 
device on the route is chosen for analysis. In step 414, it is 
determined when the chosen device was operational and 
non-operational during the sample time period. All devices 
in the route must be examined and, at step 416, if it is 
determined that there are remaining devices in the path to be 
analyzed, control passes to step 418 which chooses the next 
device, and then again (at step 414) the operational/non- 
operational condition of that next chosen device is deter- 
mined. 
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When all devices in the chosen route have been examined, 
control passes to step 420 where all "operational time 
periods," during the sample time period, are identified as 
occurring when all devices in the route were concurrently 
operational. In step 422, the route's availability is deter- 
mined as being those operational time periods. At step 424, 
it is determined whether or not there are remaining routes to 
be analyzed, and if so, control passes to step 426 which 
chooses a next route and then control returns to step 410. 
When all alternative routes and all devices on those routes 
have been analyzed, at step 424 control passes to step 428 
where it is determined when at least one route of the 
available routes was operational during the sample time 
period (i.e., overall connection availability). 

As can be seen, when there are two paths between a given 
source and destination and one path is unavailable, but the 
other path is available, the present invention will determine 
that a point-to point connection is still available. In other 
words, the operational availability of the network is better 
reflected by the present invention because, in reality, the 
source and destination are still in contact with one another 
and, as far as the user is concerned, the network is available. 
This present method, therefore, provides a more realistic 
representation of the operation of the network as seen by the 
user, 

A timeline, as shown in FIGS. 5a, 5b, 5c, Sd, 5e, 5/, 5g 
and 5h, provides a visual representation of the determination 
of device availability, path availability and overall connec- 
tion availability. In each of FIGS. 5a, 5b, 5c, 5d, 5e y 5/, 5g 
and 5h, the time period under consideration runs from time 
^ to time \ ertd . Further, the X-axis represents time while the 
Y-axis represents the operational or "up" condition (U) and 
the non-operational or "down" condition (D) of the device or 
path. 

As shown in FIG. 5a, for example, the source S 300 is up 
from time t 0 to time t<, down from time t 9 to time t u and up 
from time t ai to time t gndt i.e., the end of the sample time 
period under review. 

As shown in FIG. 5b, device A 304 is up from ^ to tj, 
down from time t$ to t 6 , up from time t 6 to t 9 , down from 40 
time t 9 to time t 10 and up from time t J0 to time t end . FIGS. 
5c, 5d and 5c represent the up/down conditions of device B 
306, device C 308 and the destination device D 302, 
respectively, over the same sample time period. 

The availability of the path S-A-B-D is shown in FIG. 5/ 45 
as those time periods when device S 300, device A 304, 
device B 306 and device D 302 are concurrently operational. 
As shown, these devices are concurrently operational during 
the time period from time to time tj, from time tg to time 
tg, and from time t J0 to time i end . Similarly, as shown in FIG 
5g, availability of path S-A-C-D is as shown. The availabil- 
ity of path S-A-C-D is determined as being those time 
periods when device A 304, device C 308 and destination D 
302 are concurrently operational. 

The point-to-point availability of the link between the 
source 300 and the destination 302 is the time when at least 
one of the alternative paths S-A-B-D and S-A-C-D are 
available. This overall availability is shown in FIG. 5h, 
indicating that the network was available between the source 
300 and the destination 302 from time t 0 to time i u time t 2 
to time tj, and time t 10 to time \ erut The point-to-point 
network availability of the connection can then be calculated 
as a ratio of this overall availability (i.e., the total time the 
connection between the source 300 and the destination 302 
was available), divided by the length of the sample time 
period. Accordingly, for the example shown in FIGS. 3 and 
5, the ratio would be: 



(Cli-to)+(t3-t2)+(t7-t«)+(to-te)+(twWo))/(LiJ-te) 



(1) 



The resulting number would, therefore, be a measurement of 
the functional availability of the connection between the 
source 300 and the destination 302 which more closely 
relates to what the users at the source 300 and the destination 
302 experienced. This measurement could then be used to 
characterize the network's overall availability. 

It should be noted that there may be periods of time when 
the status of a particular device in a path is unknown. In 
other words, the monitoring system might not have been 
able to determine the status of the particular device. In that 
event, the period or periods of time during which one or 
more device states could not be determined would be taken 
out of the availability calculation. As an example, as shown 
in FIG. 5a, the status of the source S is unknown from time 
t 12 to time t 13 , as represented by the cross-hatching. This 
would then affect the availability determination of path 
S-A-B-D as shown in FIG. 5f and, therefore, affect the 
overall availability as shown in FIG. Sh. The point-to-point 
network availability of the connection under these circum- 
stances would then be: 



J- 50 



65 



((tl-tf+fc-»2>*fo 
tl2» 



-t6)+Ct9-t 8 )+^2-t 10 )+(t <!n< rt 1 3))/((t WKr t 0 )-^3- 



(3) 



The resulting number would, therefore, now be a measure- 
ment of the functional availability between the source 300 
and the destination 302 during those time periods when the 
up or down status of the devices could be determined. In 
order to characterize this ratio where the operating condition 
of at least one device was unknown, it would be indicated 
that for some period of time of the overall time period, 
availability could not be determined. This portion of the 
overall period would be equal to: 



35 



(ti 9 -t 12 )/(t«rf-ta) 



(3) 



As one of ordinary skill in the art can easily determine, the 
method of the present invention works for any number of 
paths between a source and destination where each path has 
any number of devices along it. Further, point-to-point 
availability can be monitored on an on-going or polled basis 
so that a cumulative or running measurement can be main- 
tained. In this manner, a baseline measurement can be 
obtained. In addition, those time periods when the network 
is down for scheduled maintenance can be removed from 
consideration so as not to artificially lower the network 
availability measurement result. 

In a second embodiment of the present invention, network 
availability is calculated using weighted measures. Each 
node or device in the topology is given a weighted value 
such that the relative importance of a node with regard to 
other nodes in the network can be determined. The weight 
can be determined using different measures, e.g., how many 
nodes are connected to the node under consideration, traffic 
at the node, or classification of the node by function or cost 
of using the node. Cost may be viewed as a negative weight, 
where use of a more expensive resource has a negative 
impact on network operation. These measures can therefore 
be any parameter that determines the importance of the node 
to the user. For a given section of the network, the weighted 
availabilities of each individual device in that given section 
can be aggregated. 

For example, for a given device i, its relative weight 
(RW,) is equal to the weight,- assigned to the device i divided 
by the total of all of the weights of all of the devices in the 
section of the network being evaluated. This is set forth in 
Equation 4: 
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Weight: (4) 
RelattveWetghti = - — 

;=i 

S 

N = Number of devices 



The device availability ratio is equal to the amount of time 
the device was available divided by the length of the time 
period under consideration as per Equation 5: 10 

time device i was operational (5) 

A vailability; = - -— , J / — — 

length of time penod under consideration 

15 

The aggregate network availability of that section is then 
equal to the sum as shown in Equation 6: 



Aggregate Network Availability = ^ RelcaiveWeighi- * Availability t 20 



The second method embodiment is described in the 
flowchart of FIG. 6. At step 600, all devices in a section of 
interest (sample section) of the network are identified. 25 
Further, in step 602, the time period under consideration 
(sample time period) is determined. A relative weight (RW) 
is assigned to each device in step 604 (see Equation 4). In 
step 606, one device in the sample section is chosen and in 
step 608 it is determined when the chosen device was 30 
operational and non-operational during the sample time 
period. In step 610, the weighted availability of the device 
is calculated. If all devices have not been examined, as per 
step 612, control passes to step 614 where the next device is 
chosen and control then passes to step 608. When all devices 3S 
have been examined as determined at step 612, the aggregate 
network availability of the section as the sum of all weighted 
availabilities is calculated in step 616 (see Equation 6). 

Of course it can be seen that if the availability of a 
particular device cannot be determined, i.e., is unknown, 
those periods of time would be withdrawn from the calcu- 40 
lation. As above, a percentage of the time period under 
consideration for which availability of a device or devices 
was unknown would be reported. 

Availability reports, generated from the data gathered 
from both embodiments of the present invention, would be 45 
useful to many individuals in order to assess the availability 
of the network. For example, as shown in FIG. 7, a network 
availability report system may consist of a three-layer archi- 
tecture including a user interface layer 702, a network 
availability task or business layer 704, and a data layer 706. 50 
The data layer 706 may be implemented using Distributed 
Data Manager, (DDM) as available from Cabletron Systems, 
Inc. The user interface layer 702 can be viewed using a web 
browser. The data files can reside on a web server on an 
intranet of a facility implementing the present invention. The 55 
network availability task, in business layer 704, requests 
data from the data layer 706. The network availability task 
704 arranges the data and generates reports to be displayed 
on the intranet (user interface layer 702). 

By way of example, the network availability task 704 may 60 
generate three types of reports, A first type is a device 
availability report for devices designated by a user. A second 
type displays point-to-point availability between any two 
designated devices. A third type allows a user to determine 
the availability of a network in terms of availability of select 65 
paths. All types of reports may be scheduled ahead of time 
to run automatically or could be run by a user on demand. 
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The network availability task 704 may have at least two 
ways to obtain network topology information. First, the 
DDM can store the network topology and can update its 
topology information as a background process during off 
hours or at other times as directed by a user. In this manner, 
when a user runs a network availability report, the topology 
information is already in the database in a p reprocessed 
format. The network availability task 704 will then correlate 
the event information with the topology information to 
determine the network availability. 

A second option is to directly infer the topology infor- 
mation from what is available in a database, such as the 
Spectrum® Network Management System available from 
Cabletron Systems, Inc. A Path View application (available 
from Cabletron Systems, Inc.) uses this information to show 
a path from the source device to the destination device. 

A report generated by the present invention may display 
the uptime and downtime for a device, selected by a user, for 
a given time period. The information can be displayed in a 
step graph format similar to that which is shown in FIGS. 5a, 
Sb t 5c, Sd, 5e, 5/, Sg and 5/t. Further, implementing reports 
and analysis using SNMP protocols and taking advantage of 
hypertext links, HTTP, and documents in the HTML format, 
a user may gather and display further event information. 

In addition, a report may also display historic path avail- 
ability between two devices. A user may input a source and 
destination for a path of interest and a time period of interest, 
in order to generate the report. The network availability task 
704 will then determine all possible paths through the 
network and display them. 

A user can customize a report card for the network. In 
order to determine how a network functions during a certain 
time period, the user can designate key source and destina- 
tion pairs as representatives for the operation of the network. 
The network availability task then determines the link 
availability for all of those pairs of devices, and creates a 
report card for the health of the network which can be 
expressed in terms of, for example, poor, good or excellent. 
These grades are configurable by the user where, e.g., 
"excellent" equals availability greater than 95%, "good" 
availability equals 80%-95%, and "poor" equals availability 
below 80%. Of course, different ranges may be chosen and 
these are merely set forth as examples. The report card may 
display availability for each pair, along with an average 
availability (across the pairs) and a standard deviation. Of 
course, one can see that such reports can be scheduled to run 
at predetermined times and can include other relevant data 
regarding network operations. 

An example report card is shown in FIG. 8. As can be 
seen, for a particular network sub-section designated as 
"Nashua Router*' 802, two source -destinations pairs (in 
column 2) have been designated to represent the availability 
of this sub-section. For the first source-destination pair 804, 
represented by Workstationl -NashuaRouter, entry 806 indi- 
cates that the network availability is 98%, resulting in a 
rating 808 of "excellent." The second source-destination 
pair 810, represented by Workstation2-NashuaRouter has a 
network availability 812 of 91%, and a rating 814 of "good." 
The average 816 of these two source-destination pairs is an 
average network availability 818 of 94.5%, which results in 
a rating 820 of "good." The report card 800 is in an HTML 
document, which enables a user to link to further informa- 
tion regarding either source -destination pair 804 and 810, by 
clicking on hypertext link, 822 and 824, respectively. These 
hypertext links provide added value in that the user is told 
why the link between the source and the destination was not 
available, and not just the fact that it was down. As above, 
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a step-graph timeline (e.g., FIGS. 5a, 5b, 5c, 5d, 5e, 5/, 5g 
and Sh) can be provided to show the availability of the path, 
i.e., when during the sample time period the source- 
destination pair was available or unavailable. Any other 
graphic representation of the information could also be used. 

With the report card 800 available in a web-browser 
format, a network manager need not be directly linked to the 
network via a network manager's console (which requires 
specific hardware connecting it to the network). Further, 
access to the report card can be granted to anyone with a web 
browser and, of course, access to the report card can be 
limited via the use of either passwords or account numbers 
so that potentially sensitive business information regarding 
the information and topology of the network can be pro- 
tected. In this manner, network availability could be 
accessed through either the company's intranet or even the 
Internet with appropriate security precautions taken. 
Creating, maintaining and structuring a web browser to 
present the network availability report card is well within the 
capabilities of one of ordinary skill in the art. 

As shown in FIG. 9, a report card 900 for Network Alpha 
provides an average network availability calculation 901 on 
a particular report date for a particular time range. In 
addition, the five least available links 903 are displayed in 
ascending order. If a user desired additional information she 
could click on the "details" hypertext link 902 and be 
provided with additional information. In another section 904 
of the report card, the availabilities of particular links within 
the network are set forth. In this example, thirteen links 
between different source/destination pairs are used to indi- 
cate the overall network availability. The average of these 
link availabilities results in the average network availability 
displayed at the top of the report card. 

When a user chooses the details hypertext link 902, 
additional information 1000 can be provided (see FIG. 10). 
This additional information may include a graphic repre- 
sentation 1001 of the possible paths between, for example, 
workstations and My_Other__Router, as shown in FIG. 10. 
Those devices which have low or unacceptable availability 
may also be identified (Problem Devices 1002). In the 
example shown in FIG. 10, the devices My_Router__and 
land7repeater 2 are singled out for unusually low availability 
ratings. Events which contributed to this low availability are 
also presented. 

The weighted measures technique, according to the sec- 
ond embodiment of the present invention, can be applied to 
a calculation of the point-to-point availability as per the first 
embodiment. For example, when there is a primary path and 
a backup path between two devices, there may be a premium 
(extra cost) associated with use of the backup path. 
Specifically, use of the backup path might induce charges 
which have to be paid out of an annual budget in real dollars. 
The impact of the use of the backup path can either be shown 
(to the network manager) in a report card as a cost (in 
dollars), or as a factor which reduces the network availabil- 
ity rating. Alternatively, there may be an additional rating 
measurement for fiscal efficiency or the like. 

While an embodiment has been shown where the report is 
available on a private intranet or the public Internet using a 
browser and HTML compatible data structures it is clear that 
the present invention could be implemented in other ways. 
For example, the availability can be determined according to 
the present invention and presented as a report without 
HTML links or browsing capabilities, i.e., merely a non- 
interactive report. This approach is meant to be within the 
scope of the present invention. 

Having thus described various illustrative embodiments 
of the present invention, various other modifications will 
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occur to those skilled in the art that are intended to be within 
the scope of the present invention. Thus, this description and 
accompanying drawings are provided by way of example 
only and are not intended to be limiting. 
We claim: 

1. A method of determining availability, for a specified 
time period, of a connection within a computer network 
between a source device and a destination device in the 
computer network, the method comprising steps of: 

determining all routes between the source and destination 

devices which existed within the computer network 

during the specified time period; and 
for each respective determined route: 

determining all devices which were on the respective 
route during the specified time period; 

for each determined device on the respective route, 
determining an operational time period during which 
the respective device was operational and a non- 
operational time period during which the respective 
device was not operational during the specified time 
period; 

determining the respective route to have been opera- 
tional during any period of time when all devices on 
the respective route were concurrently operational; 
and 

determining the availability of the connection as a 
function of all time periods when at least one route 
between the source and destination devices was 
operational during the specified time period. 

2. The method as recited in claim 1, including: 
determining when no route between the source and des- 
tination devices was operational during the specified 
time period. 

3. The method as recited in claim 1, wherein for each 
respective determined route the method includes: 

adding together all periods of operational time during 
which at least one route between the source and des- 
tination devices was operational during the specified 
time period to determine a cumulative available time 
duration; and 

determining a ratio of the determined cumulative avail- 
able time duration to a duration of the specified time 
period. 

4. The method as recited in claim 1, including displaying 
the determined availability of the connection. 

5. A method of determining availability, for a specified 
time period, of a connection within a computer network 
between a first device and a second device in the computer 
network, the method comprising steps of: 

(a) determining all routes between the first device and the 
second device that existed during the specified time 
period; 

(b) determining all time periods when each respective 
route was operational during the specified time period; 
and 

(c) determining the availability of the connection in the 
computer network between the first and second devices 
for the specified time period as a function of all 
determined time periods when at least one determined 
route was operational. 

6. The method as recited in claim 5, wherein step (b) 
includes: 

(bl) determining each device on the respective route; and 
(b2) determining an operational time period during which 
a respective determined device on the respective route 
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was operational and a non-operational time period 
during which the respective determined device was not 
operational during the specified time period. 

7. The method as recited in claim 6, wherein step (bl) 
includes defining the first device and the second device as 
devices on the respective routes. 

8. The method as recited in claim 6, wherein step (b) 
further includes: 

determining the respective route to be operational during 
any time period within the specified time period during 
which all determined devices in the respective route 
were concurrently operational. 

9. The method as recited in claim 8, wherein step (c) 
includes: 

determining the availability of the connection to be a ratio 
of a total time during which at least one route was 
operational during the specified time period to a dura- 
tion of the specified time period. 

10. The method as recited in claim 9, wherein step (c) 
further comprises: 

adjusting the ratio to exclude those time periods during 
which the operability of at least one device was 
unknown. 

11. A method for determining availability, over a specified 
time period, of a predetermined section of a computer 
network, the predetermined section including a plurality of 
devices in the computer network, the method comprising 
steps of: 

(a) determining a relative weight value for each device of 
the plurality of devices; 

(b) for each device of the plurality of devices, determining 
an amount of operational time the respective device 
was operational during the specified time period; 

(c) for each device of the plurality of devices, determining 
a weighted availability value equal to the respective 
relative weight value multiplied by the respective 
operational time and divided by the specified time 
period; and 

(d) determining the availability of the predetermined 
section of the computer network to be a sum of the 
determined weighted availability values of the plurality 
of devices in the predetermined section of the computer 
network. 

12. The method as recited in claim 11, wherein step (a) 
comprises steps of: 

(al) assigning an absolute weight value to each device of 

the plurality of devices; and 
(a2) determining the relative weight value for a respective 

device to be equal to the absolute weight value of the 

device divided by a sum of the absolute weight values 

of the plurality of devices. 

13. The method as recited in claim 12, wherein step (al) 
comprises steps of: 

measuring a number of messages which passed through 
the respective device during the specified time period; 
and 
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determining the absolute weight value as a function of the 
number of messages which passed through the respec- 
tive device during the specified time period. 

14. The method as recited in claim 12, wherein step (al) 
5 comprises steps of: 

measuring a cost per unit time of operating a respective 
device during the specified time period; and 

determining the absolute weight value as a function of the 
cost per unit time of operating the device during the 
10 specified time period. 

15. The method as recited in claim 14, wherein step (al) 
further comprises steps of: 

measuring an amount of time the respective device was 
i5 utilized during the specified time period; and 

determining the absolute weight value as a function of the 

amount of time the respective device was utilized 

during the specified time period. 

16. The method as recited in claim 12, wherein step (al) 
20 comprises steps of: 

measuring a number of other devices to which a respec- 
tive device was connected during the specified time 
period; and 

determining the absolute weight value as a function of the 
25 number of other devices to which the respective device 
was connected during the specified time period. 

17. An apparatus to determine availability, for a specified 
time period, of a connection within a computer network 
between a first device and a second device, the apparatus 

30 comprising: 

a discovery tool coupled to the computer network to 

discover a topology of the computer network; and 
a processor coupled to the discovery tool to receive the 
discovered topology of the computer network and to 
35 determine all routes between the first and second 
devices in the computer network and to determine all 
time periods during which each route was operational 
during the specified time period; 
wherein the processor determines the availability of the 
40 connection as a function of all determined time periods 
during which at least one route of all determined routes 
was operational during the specified time period. 

18. The apparatus as recited in claim 17, further compris- 

45 iDg: 

means for displaying the determined availability of the 
connection. 

19. The apparatus as recited in claim 17, further compris- 
ing: 

50 means for identifying all routes in the network between 
the first device and the second device; 
means for identifying all devices on each identified route; 
and 

means for determining an operational time period during 
55 which a respective identified device on each identified 
route was operational. 

* * + + * 
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